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ABSTRACT ^ 

This study in vestigated w hether various ' kinds of 
preschool programs have differential cognitive effects on different 
kinds of children. Relevant literature was reviewed and data, 
generated , iji the first 2 years af the* Head Start Planned Variations 
Study {FTSfe were anavlyzed. The eight preschool programs associated 
with the PVS i3ere considered/. Children's characteristics used for 
analysis were initial ^||tlii:yi, previous school experience, sex; age, 
^ocioeiponomic status, e^hicity, and style of response' to testing. 
Cognitive outcomes were assessed with the Preschool Inventory and. 
S tanf ord-Binet. Several tentative conclusions were drawii. First, some 
children characteristics interact more powerfully than ot hers, with 
characteristics of preschool models. Response style and previo'^is • 
schooling seemed the most iaportant variables. Second, where 
interactions are consistent, they follow suggestive patterns. 
Educationally disadv'a ntaged children seem to achieve more in highly 
directive progtams than in less directive ones. Third, the 
interactions may be significant factor's in preschool success or 
failure. Many educational approaches „may be needed, to t>e delivered 
in a flexible classroon( designed to accomodate all ki^nds of children. 
(DP) - . 
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Bib 1 iographv^ 



Abstxact ' . . 

Ihis report addresses the ^issue of v/liethcr different preschool 
programs have different cognitive^-ef facts on different type^ of diild- 
ren. Specifically, it fociises on three inter- related cjues,tions. 
First, v/hat diaracteristics , or types of characteristics, of children 
interact: nio3t. paverfulXy with cliaracteristics of pre-school pTO^grairs? 
Second, \vtiat are tlio patterns of such interactions? Ihird, and -most . 
broadly, hav inportaiit are these interactions in explaii-ung the cogni- 
tive outcorjiGS of different progrcims? Hiese questions elre investigated 
tlirougli a selective revie\v of relevant literature -and tliroac^i analysis 
of 'data generated in tlie first ;b*/o years of tlie Head Stari: Planned 
Variations Study. * . , " 

Tne repbrt is in three parts. Part I proposes and justifies ^ 
h]^x:)tiieses concerning the interaction of particul.ar preschool proJgranr 
"aj^particular 'diaracteristics of children. Ihe hypotheses are based 
on the findings^ of previous conparative preschool evaluatioiis and on- 
ajia^^is pf data generated 'in the first year of the Planned "Variations 
Study — 1969-70. Part II reports the results of testing tliese hypo- 
theses on anotlier body of data — that generated in the second year of 
• the Planned Variations Study — 1970-71. Part III discusses patterns 

emerging from tihe t^;o analyses • - • • 

C 

Ihe programs of pr^schooling examined are the eiglit involved 
in botli the first and second year of tlie Head Start Planned Varia- 
tions Study. They represent a wide spectr\:mu"of .approadies to early 
education: . ' ' ' • ■ 



'a. Academic Preschool Program: Engleirtann~Bec}'.or; 

b. Behavior Analysis I^todel: Biisheil. 

c. Cognitive Model: 'Vfelkart. 

d. " Parent Educator Model: Gordon^v 

0, Tucson Early Education Model 

f . ■ Rssp5nsive Model: Far West Laboratory. 

g. Open DJucation Nfodel: Educational Devolopnxint- Center. 

h. Bank St;t:ect Approach.. " . 

, All programs are exainined separately in Part I, to generate hypo- 
theses. ,In Port II, tlio patterns enlarging fi^m ihe first yeai of 
Pl^inncd Variations data--7l969~1970-- Qre used as a basis for groupie 
certain models togetiier on a continuum running from ^'mgre-directi^" 
to "less-directive". -Ihese categories are used to test certain h^^po- 
thcsefe prcposcd "in Part^I, and are explained and justified in Part II.' 
. , Ti-ie children's characteristics &$Gan\ined here are: 

1. : initial fibility. ■ . , " , 
.2. previous scliool ("}q^::rienco. 

3. sex. ^, . 

5. socio-econoniLc status. 

6. ctlinicity. 

7. ^response style; particular aspects of the ways in 
whldi children -respond to the', cognitive demands pre- 
sented iyi the Staijford-Binet pre^test, as msastured 

; by^ the tlprtzig-Bif ch method of - scoring . 

fihe outcome neasures are two cogniti\^ tests: the Preschool Inventor^^ 
and the Stanford Binet IQ test. 

The author cc»iclude.=: that because of the limi tatipns bf the t^vo 
measures used to assess cognitive gains , and because of tJio 'many incon 
sisbencies, between patt/Bnis of athi^vcncnt j:or iho two t(^st.s and tlio. 
two ycars^of data, extrenr:? caution is necesscu.y in eva],uiting the 
educational significance of tlie patterns emsrging from the analysis. 
Nevertheless the report suggests sane tentative amswers to the three 
questions which motivate tKe study. 
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^ First, across the two^ years of tiata, some chilcifen's ciiaxacter- 

isti.cs interact irore powerfully than otfiers v;ith cliaracteristi.cs of 
presdiool models. Specifically, prior preschool experience and chil- 
dren's style of response to testing indicated by tlie .llertzig-Birdi 
scoring of the Sta^ ford-Bine t) interact in a reasonably obnsistent. . 
v;ay with the rrodels — across the' two years of data, althouqii not 
always across the two cognitive measures usQd. Ethqiiciti' and socio- 
(.economic status, l^y contrast, do not shov consistent and substantial 
interactions across the two sets of dat^. For thi-XK^ otiier childi'en's 
diaracteri sties , 3ex^ age, and initial ability, the picture is mixed:'' 
interesting interactions of sone mgnitude emerge from the second 
year's- analysis but as these are unreplicated, they arc treated 
cautiouslyr Ihe author notes that the characteristics thiat shew 
consistent Lnteracti(^is with .the models — prior pr^schooling and 
response st^de — are the variables whidi relate most directly to the 
child's behavior and e>?)erience in the classroom, and which are most 
likely to change over^ftime. 

ScK'ond^ in generaJ.^ where interactions ai^ strong or consist&it 
across tiie two years of data they follcw suggestive pattenis. 
Specific<^ily , for pariiicular cognitive measures "more-directive" 
models se€2nv-tb favor tlie achievement of children witliout prior pre- 
school experience, those whose ihit^l achievetnent on the Presdiool 
Inventory is belo/ the sasple moan, and those whose response style is 
less mature* ^hese patterns both parallel and qualify interactions ' 
reported by Bissell (70) and Bar-^Yam (69), These researdiers find - 
cshildrfen who mi^t be described as "oducationally^isadvantaged" 

,9^. - -.,../ 



adiieving tore 'in highly dire^t4Aj^e envixorjiients . than, in less-directive 

. ^' " ■ 

ones. Bar-Yai^'s research relatea to student ability.- level, wlji^e 
Bissell's pertains to socio-ecqncmic status > but ±he patterns are ' 
^ similar. '/ . ' ' - 

• Third, the Planned Variations analyses . indicate that interactions 
may be quite inportant In understanding 'tlie cognitive outcomes of pre- 
school programs. None of the preschool programs is consi3teny.y more 
effective in raising the test scores of all Jtypes of 'ctiildren across " 
both the two cognitive measures used'^( although one prograon does appear' 
to Joe far more successful than others in boosting IQ) . Furthenrore , 
when particular models are (^oiped as "more-directive " and "less- 
directive" the main effect of ntxiel-group explains far less unique 
variance than do interactions of model-group with background character- 
istics. Jliis sa3ggests that monolithic prescriptions and monolithic 
^^ategorization of children iiey be an unlikely avenue Tor educational 
advance. It also suggests the need to e>q:)l0re educational approaches 
that cater to tiie Vciriety of diildren in every classroon, even class- 
-jopoms in programs designed specif ici^lly for the^poor. 



INTROrXJCTION 

) ' ' ■ 

* 

Evaroatioiv of the outccrres of *,preschool' prograirfe raises at least 
Jdiree • typf=jfe of ^luestions. First, tJie ctuestion of overall effective- 
ness: . whidn 'pnDgram or ^type of program produces the greatest change- 
on one or more Jmeasures, or whicii produces significant/ diange on the ^ 
ireasutres believed^to be most Lnnportant? ^ Second, do different programs 
have different patterns of outcomes — some producing cognitive change, 
for 'exanple , sorre' leading to errotion^l grcwtli, and oti'iers to progress 
in. the areas of sensory develofxnent and no tor contix^l?- 'Ihird, do tlie 
diffejiftnt prograiTF produce mcodmum gains with different types of 
' children, soth working well in the south, and others; in. tl:ie north, sorie 
, being more effective with ^very young children, or tliose of hxgh ; 
ability, etc.? ^ ' 

Tliese questions are of course not? separate\and distinct, sino^ if 
outcaa^s' of different programs actually are' quite different, or X[. 
peirticular programs tejid to be more effective 'with one t^'pe of child " 
than another, t?ien estimates of overall effectivc^ss will change 
when outcone measures or sanple ^-selection p'rooedurBS change. • r 

Out of the considerable body of research done on preschool 
programs, some fairly consistent patterns ha^ye en[Brged about overall 
effectiveness, and also about the range of effects we can and cannot 

4 

hope for from preschogl programs . Ihe question of whether particular 
ch.ara!5teristics of chiTdren interact witli program chiaracteristics has 
been addressed .in a nuntxBX of studies (see, for exanple , M^Lssell , 70.; 
Hodges, Spicker and McCandless, 67; Karnes, 69? and 1^-aft, l'\ischillo 



and'Her'zog, 68)-. For one child-characteristic, socio-ecoTioniLc status, 

a reasonably consistent pattern has emarged across a nuirber of studies* . 

(Bissell, 70).^ For most other diaxacteristics findings of different 

studies iiave been airbiguous or contradictor^'. 

Hie fact that few consist^ent, well--docuiTented interaction patterns 

have eiiX^rqed to date may be in itself ^.evidence on the qijostion of 

whetJier first-order"^ interactions- are' significant in e>plaining the 

results of different programs. However, it seeire at this point tnport- 

, ant to "try to explore "the interaction problem'^with another large sanple 

Qf children and prograiris. Ihe information generated by such an 

e>iploration could be inportant both for practical and for theoretical 

reasons: solid informataon oi-what types of prograiTi best prcnote 

. — • . r . 1 

cognitive gras^h for particialar t^pes of children can help adminis- 

txators and parents choose prcKjtrarrs for specific groins of children 

fcind can aid teachers iVi tailoring' classroom practice to the needs of 

indivd^al children. On tlie theoretical level, .empirical data on the 

type of interaction that occurs between particular educational models 

and specific characteristics of children inprove oul: understanding' 



1 * 

Crne reason for contradictory interaction patte^ms reported in differ- 
ent studies (several will t>e noted later; they are especially plenti- 
ful in the area of sex-by-nbdel interactions) may be second-order 
interactions » Hhvs , for exanple , program A mic^t shov large gains for 
girJs'of hi^i ability, and bcr^s of low ability, while program D 
favored girls of lew ability and boys of hi<^ ability- If .,the sample 
was balanced by sex and ability, analysis would reveal no first- 
order interactions — neither sfex-by-model nor ability-by-model, A 
second study, in vdiich all sufcjjects were of r low ability, would shew a 
strong sex-by-model interaction; a third study, using subjects- of 
higher ability would, show sex^-by-nxxtel effects in exactly the opposite 
direction. ,11his example Xs perh^s too tidy to be realistic, but it 
illustrates hew second-order interactions might produce appa^eaitly 
coriti^adictory patterns when only one dhi Id-variable is considere<J. 



I 

of the relation between classroon practice and chilciren's li^aming. 

"Finally, this t^pe of information ciar^i affect , the design of future, 

evaluation studies^ and thfe i^i1;erpretati-on of those done in tfte past. 

iX^uS f an inproved understanding of ;iht<^ractions increase tlie 

precision of bur estimates of preschool prograins' overall effecti^/e- 

ness. , ' . - ' 

• * % 

Hie preset report, focyses on the interaction -q^jestion , attenpt- 

ing to answer, or begin to answer, three interrelabcxrquGStions 

First,^ vjhat diar^cteristics*, or types of characteristics of dii>ldren 

' • , J' 

interact' most strongly with characteristiics o^ pr6gxcims? Second; 
«t 

what are the patterns of such interactions as do appear? Do they 

\ 'A 
relate at all to the schemes and considerations ^idi haye be^r 

used in tife^ past to classify presdiool prog^jre? Third; and rtost 

broadjy, hew iirportant are interactions between characteristics of ' 

diildren and those of presdiool prograirs? Can it be s^d that tliere 

is one "best" program for Head Start's target population, or ratl'i^r 

that tlie program which most effectively promotes cogni'tivie gxwth^ for 

one group of childrejn is net the one which works ^best for another? 
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I^sj^. of the Study 



These £ire very broad cuestiona. Th^ present report atterrpts to 

■ y.llxjminate them by e^loring the relation between a finite' nunber of 

child chcifacteristics , preschool prograitis, and outcome measures. 

, BecaiSe' yie- preschool literature sheds a rather uncertain light on 

several of tlie interactions under study, hypotliesis generation has 

been- seen as a major task of this report. And althpugh certain preschool 

studies have proved to be invaluable resources, the approach to tlie 
* ■ t . 

problem has had to be- in part enpirical. 

For tills re^^on thq, report is i.n three parts'/ Part I uses ^he 
rqsults reported in selected presdiobl -Studied and the data gert^iated 
in t^l^ first year (1969-70) of the 'Head Start Planned Variations - 
. Study-^ (PV) as a basi^^ for proposing i>pecif ic hypotheses concerning 
the interaction of preschool programs and child characteristics; 
Part II describes the res^ilts of testiiig these hypotheses on another . 
body of da.ta~that g^ierated in the second /ear (1970-71) of the 
Planned Variatiohs'^udy. Part III dist^usses patterns errerging fron- 
^the two analyses. 



Planned Variations is a tiiree-ypar study in which fcwelve-4ifferent 
sp5nsors have beeri given funds ^d facilities to inplement tJigir^irodel 
of preschooling in Head Start centers in sever&l sites across the^^^- 
country. Data have been collected on 'children in these sponsored class-- 
^ rooTts and in -GOTparison classroars (Head Start Clashes in v^ich no 
sponsor is attenpting to inplement his model of prrfschooling) . These 
data incljjde both dertographic'l^Mormation and prte^ and post-scores 
^' on a v«?iety of instruments* 

For a descrj.ptK3n of the design and selected analysis of year 1 
of Head Start 'laanhfiQ Variations see Inplarentation of Planned Varia- 
tions in Head . StarH -SRr; 1971. ^ 

For a description of measures used in all the years of HSPV, see 
WWalker, Bane am^ryk/ The4?uality of th^ Head Start Planned Variation 
Data , Huron Institute, 1972. 



Models 



The nxxiels of preschoolAg are .the eigiit included in all three 
years of the PV study: 

1. Academic Preschool Program: Engelmann-Becker (E-B) 

2. Behavior ^lalysis Model: Dai Bushell, University of Ijansas 
'3. Cognitive Model: David Weikart ; 

4 Parent Educator Model: Ira Gordon University of Florida, 

5 . '^son Early ^Education Mod&l : . University of Arizona ' 

6. Responsive Model: Far West Lab^ ^ . ^. 

7- Open Education Model:- Education Development Center ^^^^ 
8. Bank -Street Approach: Bank Street College of Education 
llie first? two models listed are based, in quite different ways, on 
rbehaviorist assuirptians ^d techniques. Bank Street, the last on the 
list, is tlie model vvtiich probably oomes closest to the "child develop- 
ment" approadi ^idi ha^ flourished for mor^ than thirty years in mid- 
dle-class nursery schools and — ^morfe recently — in many Head Star^ ^ 
centers. The oth-er five models are difficult to* characterize^ brie fly; 
all of t±iem offer soire. structure through vsrtiich teachers btk^ aid^es may 
provide for children's cognitive devefc^ment. The methods for accarp- 
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lishing this goal are many, but it is probably fair to say tl^iat 
Gordon's program places ntxjor eirjtiasis on contactSr with parents, while 
Tucson, EDC, and Far West rely more heavily' on a three-way encounter 
be tweeri^ilc^ teacher and materials. {Hie degreg to which such en- 
counters are planned- in advance is not always clear from model d'^scrip- 



tions and may vary considerably fron classroom ^J^pfclaesroom, as well 



a3 modei to model.) The Weikart pro-am is based on a Piage"^. 



'6; 

" ... ■ * " 

framework of cogniti-ve develcprent , and errphasizes^, ■ aiiiong other things, 

4 

the sequencing of learning e^^^eriences acoorcJing to such a f rame^N^ork : 
Because any a^teirptr.to charac±erize ei(^t sc^isticated approaches to 
early education'^.ln a few sentences is bound to inislead, the reader i is 
referred to tlie sicrrnaries in ^taccob/ ^d Zellner (70) , and ifi the 
Ifead Start Planned Variations Sto:^ (71) , 

These nxxSels have been categorized in a variety of ways by other- 
resea:^er3N Stanford Research Institute (71) has us^i three cate- . 
gories: "Pre-acadeinic" , >tiich includRs Engelinann-Becker and BusheH; 
"Cognitive Discovery", v^ch includes Weikart/ Gordon, Tucson and Far 
West; and "Discovery", '/*iich takes in Bank Street and EDC. David 
^ We^art, who uses a rnatrix^ describing who (teacher, child, both, or 
neither) initiates learning gx^rienoes ,« groLps sore of them as 
follows (Wfe5^3^^ 72) ^ ^ , 

^ • ■ ^ ' ^ / 

PrograiTOied \:iirricula (teacher initiates) EngelrrBnn-Becker; 
C ^ild-centered curricula (child initiates) : Bank Street, Tucson, 
\ ' Far West; 

Open Framework '(both initiate) : Weikaj.i:. ^ 

He probably would add Bushell's nodel to the, "pix^grj^mned" category and 



':^*s to the "child-centered" group. 
^ Rochelle Maye;r> in "A Corparative Analysislof Preschool Curricu- 
lum Models" (1571) constructs a typology of models >*UGh depends on the 
ini|x:irtai?oe a model places on each of three types of interaction: 



i teacher-chi;ld, child-child, and child-material. Mayer examines, four 
types of preschool model. The "verbal-didactic" (Bereiter-EngeLfnann) 
V ranks highest on teacher-child interaction; the child develc^xmnt ^ 
model places primary emphasis on diild-diild ipteractions ; the "sensory 
cx>gnitive "^^ o^^fttontessori model ' stressee" child-naterials oohtacts more 

ERLC ^ * 



than any otiier model examined. The fourth model she e^jamines, Weikart's 
"verbal cognition" program, stresses all three types of interaction, 
concentrating on none to the e^cclusion of another. Since many combina- 
tions of enphasis' are possible, ,,this doe.s not constitute an e^austive 
list of model types. 

Althougii no two researchers are in conplete accord about model 
graupings, all agree that Bejreiter-Engelmann and Bank Street, for 
exanple, represent quite different approaches. A conpept oartnonly 
(though not universally) invoked in describing the differences between 
these programs is that of "structure'*. 

The word "structure", as .Mayer's carefM analysis (1971) illus- 
.trates, has served an invaluable function in focusing attention on 
real differences and ^similar! ties between approaches. But, as Mayer 
pointe out, tliis\ use of' the term "structure" — espetially when models 
arc?, cxxitrastod as more or less structured — is misleadiuc]. Many models 
wtiidi are termed "less -structured" are, in anotliei: sense, highly s true- 

tured: in the area of greatest program errphasis', teachers are care- 

- ' / 

fully planning and" sequencing ahildren's e^<peri^oes. 

For this reason I prefer to use the less airbiguous term^"direc- ^ 
tiveness" to describe the difference between the models of certain FV 
sponsors. Hiis tierm refers to the extent to vrfhich teachers and other 
adults decide for the child how he wiir spend his time in school, v 
*Ihere are, of course, no models v^ich are totally "non-~directive" , 
since tlie w^y in which, tJie • 6 lass roqm is sot ip almost always makes 
soTiB activities mbrc possible — and' more attractive — tlian^ otliers , ovej:i 
in the absence of adult intervention. Beyond this, all teacl^ers 



establish and attenpt to enforce seme rules about children's conduct; 
nearly -all teachers have some sort of sdiedule determining i^rfiat acti- 

;vities or options are available at p^articular times. There are consi- 
derable differences betw^een models concerning the extent to vshich spon- 
sors expect adults to oversee children's choices directly and person- 

, ally — to. tell each child what to do each day, Ihus, in models whidi • 
are termed "less -directive", children make significant choices about 
hov and with vs^iom, to spend time, for af le^t a part of each school 
day. In "more-directive" models, adults make iTBny more of these ' 
decisions for children. v" ' 

It would not be possible to place all PV models on a "directive- 
nc^ss" continuum (Gordon's Parent-mucator model would, for example, 
'be hard to loc:ab?) but it does^seem clear that Busholl cind FiKfGliTiann-- 
. l^^cker are ''significantly more directive, at least in concepLion^ than 
Bank'Street, EDC, orTarWest. ' " . " 

^ Much of what I ha\'e said about these educational approaches is 

• theoretical — it is based on sponsor's model descriptions. Hc^ differ- 

'';ent are models in terms of (vtiat^actioally goes on in classrocsns? Vfe do 
not have the information needed to answer this question fulj^y^ butxthe 
Classrocan Observation data, collected on PV and corparison^ class roans • 
givps information on sane aspects of classrocm practice in the second 
year of the* PV study, 1970-71. Specifically, this irlstrumerit describes 
the configuration of classroon activities at given intervals throuc^i- 
out the day, arid the frequency of certain behaviors and types of inter-- 
action. We can learn from the observation data, for exanple, vdiether 
teachers in particular classrooms ask thou^t questions, "^b^ otten 
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tliey infqrm cliildren directly, and v\d-iether adults are moxx? often with 
diildren individually, in small groups, or a^'a cl2i^s. However,, there 
is a, good deal about the specific content of the encounters whioh the . 
instrurnent cannot tell us. ' 

Carol Lukas and Cindy Wohlleb, in their* analysis of this data (72) 
find highly significant {p < .001) betveen-niodei differences on nearly 
all of the fifty-one observation variables: HoA/ever, interpretation, 
of -these differences is often oorplicated by large differences between 
sites witliin models. It 'does seem clear fron their analysis that on 
nveasurc^s like "frequency of academic activity", "adults with children 
in academic^ activity" , and "independeiit child activity", model differ- 
ences ore higlily significant and pretty mucii in the direction vAiich 
model descriptions would lead us to expect (See Lukas and Wchlleb, 12, 
for further description of the conservation measure and exact figures 
on these ai^d other variables). However, the rgany obsJLacles to imple- 
mentaticn. which they describe in their report would lead us to imagine 
that the subtler aspects of the nxxi|l are not always in line with model 
descriptions. . Since we have only a rough idea: of how all forces corxe 
togebher to form ^^gfect classroorrj practice , we must be cautious in 
making assunptionif about model differences. 

in the analyses described in P^urt I of this report, programs have 
not been grouped in advance acxx^rding to any categorization sdiene. 
They have been examined separately for several reasons. First, and 
most important, the purpose of Part I is exploratory; it therefore 
s^ems oounterprodUQtive to limit analyses at the start through the use 
of a priori groi:pings. Second, given the documented problems in 
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iirplernenting- models on a national scale in the Planned Variations 
study (LuJcas and Wdilleb, 72)^ both the niodels and their effects may 
be different enough to pBke the conventional labels in^prDpriate. 
Looking at outoojnes of each program separately reduces the likeliliood 
of c±)taining statistical significance but may increase our under^. ' 
standing of tlie usefulness of pctrticular types of categorizations in 

I. 

understanding the educational process. 

* •»'\ ■ ' 

- ' Because the results df the analysis of the 69-70 dat^ described 
in Paxt I suggest that the dimension of directi\^sness may be relevant 
to interactions ^?rith some variables, certain models are gi'oiped 
together , for particular analyses in Part II. Ihese groupings are 
based priaiarily on sponsor model descriptions; they are described in 
Part il. ■ . ^ * ' \ ^ 

B. Characteristics of Children '*''. * 

(.* ^ ' 

The child characteristics examined! are as follows: 

* - ■ ' I' 

1. Initial ability 

2'. Previous preschool e5$)erienoe 

3. Sex . ^ ■ , 

* 4 . Age 

5. Socio-ecanomic status (SES) 

6. Ethnicity . * • ^ • 

7. Response style: particular. aspects of the way in which 

"-Ihese diaracteristics are described iiore fully in the chapters 1^6 lew- 
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c±iildren respond to the cognitive demands presented in the 
Stanford-Binet IQ test as measured by a procedure simlalr to 
the Hertzig-Birch scorLng. 
Tliese characteristics, were chosen because they represent a range of 
variables, botl"! demographic and psychological, and because there was 
reason, either eiTpi;:rical or theoretical/ to suppose that they might 
interact with characteristics of preschool programs. 



C. Qutcone Measures 

The outcone measures used are two cognitive tests, the Preschool 

Im^entory and the Stanford-Binet." There are four reasons for this 

choice. First, tliese two measures have higher reliability than any 
. i \ 



^Tlie Presdiool Inventory, develcped in 196§ by Bettye Caldwell, is 
basically an achievement test, designed to measure knowledge ih arpas 
.that are relatively independent .of a child's, particular background and 
e^^rience. ' It tests tlie child's level of general information with 
items like "Where do you gO when you are sick?!' and "Color the triangle 
yellcw". This test is very sensiti^/e to"^' maturation, with the. greatest 
jgains being mad^ by the younger pre;Schoolers^ in ithe PV sanple Becaiase 
scores for this test have not been. noriDalized fcr age ,7as arq: the Binet 
scores) raw gaii^ are harder to interpret. Thus, the child \A\o gains 
six points on th^ PSI in ei<^t months may actually have lost'' ground in 
relation to his age gioi:p ^(this would dppeiid on his age) ; this is not 
true for the "^Binet. 

The Stanford-Binet, althou^ it does presuppose certain knowledge 
on 'the part of the child, is intended not to be an achieventent test 
but rather a test of the child's learning -ability. Many., althoijyh not 
all / of the items require the child to solve problems , both verbal and 
non-^vexbal: he is .asked to duplicate a block bridge built by the 
e5<perimenter',^-to identify^ missing or incongruent objects in a picture, 
to coirplete sSntences by si5^)lying cipposites (e.g., "The day is light, 
the night is ,") 

The Preschool Inventolry was administered to all children in the 
study, while the Stanford-Bj^t Was given only to a randcmly selected 
50%. For tliis reason certain models are excluded from particular IQ 
analyses, due to small cell size. 
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Others used in idie PV study in 1969-70,^ Second, they are irore 
often used in preschool studies than the other tests used in tJie PV 
study, and hence. are better knowri and most easily interpreted. Hiird, 
althou(^ the goals of the Planned Variations models vary greatly, all 
models include as an aim facilitating sane kind of cognitive growth. 

^ Finally, previous research bearing on interactions between program and 
diild diaracteristics has dealt largely in outoonie n^asures of adii^ve- 
ment and cognitive functioning. It seemed desirable to use this 
research in for/mulating hypotheses; therefore, it rrade sense to choose 
conparable measures. 

Nevertheless, although these two tests are the best indices of 
children's cognitive development available to the Planned Variations 

. Study, tliey are far from satisfactory if taken as conplete measures of- 
the cognitive effects of preschooling or of the degree tp which PV 
sponsors have achieved their cognitive goals. Ihis point has been 
made before (See Zimiles, 1970) but is repeated here as a caution in 
interpreting what follows , The iimitations in the content of cognitive 
tests are' striking. Although they can measure aspects of the 'knew- 
ledge and information which the child has acquired, they cannot ^ 
Treasure the nature of his conceptual functioning — for exanple; the 



-^he test-retest reliability for the 1937 scale of the Stanford-Binet 
for children 2h to 5^5 ranged from .83 to .91, depending- on the IQ of 
the child (tjie reliability is highest for children in the lowest JQ 
xan'ges). Ihe reliability of the 1960 scale (used by PV) is probably 
higher, since only the most reliable items are included in' the revised 
forni (exact figures are not, however, available for tlio 1960 l^vision) . 

The- internal. (KR-20) reliability of tlie PSI is 4x)ut .?0. For 
technical informtion on these two instruments, see .Walker, Bane, oixX 
13ryk, Ihe Quality oi the Heads tart Planned Variations Data , Huron 
pYr"^^^^^' 1972. ~ ^ • 



13. 

strategy a child uses for classifying and ordering events, or the 
v/ays he infers cause and effect. FurtlienTore , they say little about 
personality traits like initiative / flexibility, and perseverance, 
which many preschool planners consider a part of cogniti,ve function- 
ing, and which they intend their programs to foster. 

In addition to these limitations of content, tliere are those of 
context. Many pecple-^-especially young children from la^ income 
families — do not function at their best during a test (Zigler and 
Batter field, 68). Vnis is true even when the tester is familiar and 
trusted; it is nore true v^en he is a stranger (seo l^isman^ 62; and 
Labov, 69) . Furtliermore , node Is vary in the degree to vsdiich tliey 
prepare cliildren * for the didactic context of- the test — ccnplicating 

r 

interpretation of data still further. 

Neither the PSI nor the Stanford-Bine t was designed to evaluate 
the success of a particiiLar program in meeting specific goals. On the 
contrary, both tests cire intended to be "curriculum- free" — appropriate 
for a wide variety of programs. They are intentionally insensitive 
to subtle differences between programs. Indeed, ^1 W sponsors have 
nwrjor cognitivi^ goials v^ich Uiese instruments do not tap. Yet tlie 
subject matter of the tests is so broad that it is hard to be sure 
exactly what the tests do meeisure. 

For all these reasons, the results reported in th^e pages must 
be interpreted with caution. Vhen analysis shows one groi:p of childiren 
outscoring another on the PSI in Itodel A, the temptation is to say that 
these children are "benefitting" more. But it is iitportant to remember 
that we 'have evidence on only a very limited of benefit. Often 
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the effect does -not even extend to all cognitive tests, imch less to 
other cognitive and non-cognitive goals of preschooling. 

We use these cognitive ireasures for lad^ of ot±ier equally 
reliable instruments wtiich measure other kinds of cognitive growth. . ' 
If we keep their limitations firmly in- mind, then they^can give us ; 
certain kinds^of information' about effects of particiilar programs on 
different types of students. But .if we assume, without any adequate 
evidence, that the results we axe recording describe a pattern of total 
cognitive grOATtli, we may well be misled. 
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PART I: Pr/POniESES 

/Literature Review and Report 
on the 1969-70 PV Data 
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Introduction to Part I 

Strategy for generating hypotheses has two steps. The first 
is a selective review of the literature relating to interactions 
between the variables and the nxxiels under stud^* IWo. bo(iies of 
research see^n particularly relevant. The first oanprises the groip of 
stiodies which, in evaluating the inpact of particular preschool irpdels 
investigate the possibility of interaction betw^^n these models and 
one or more of the child 'bhaafacteristics on v^^lich this paper focuses. 
In a number of such studies, interactions are not e^^^lored explicitly, 
but the data presented suggests that a f^airticular interaction has or 
has not occurred. In such cases the data is used tfo generate hypcir 
theses. ' 

A second groi^ of studies,' the ^titUjde:-treatinsnt interaction 
literature, examines ^ the interaction of specific educational treat- • 
irents with particular ^attributes of students . Ihe attributes selected 
are, in general, more psychological than demographic — e.g., level o;f 
anxiety, conpulsivity, general ability, specific abilities. In most 
of these studies the subjects are school and college students ratHfer 
tlian pft:eschoolers . ^his 2:eseai:ch is not used as ^ extensively as' -^le 
preschool studie^, but where findings or hypotheses seem especially 
relevant they are suinrerizecl. 

The second step in generating hypotheses is analysis and 'e:>^lora- 
tion of the data from the first year — 1969-70— of the Head Start 
Planned Variations Study, In general /the strategy is as follows.: 



r 
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1 2 * 

for each child variable , t^so-way-^ analyses of cp-vijrianbe are used bo 

evaluate the iiiportance- both of the variable and of the interaction 

between tlie Variable and the rriodels in ^^lainin^ the variance in 

post-test scores on the Stanford-Bmet and PSI ^nd qains-^ on these ^ 

- 4 
two bests. 

«j . " 

-^ihe possibility of second-order 'interactions (see footnote on p. 2) 
suggests the advantages of using three-way analyses, rather than ^ two-- 
way. ' However, small cell sizes and an unbalanced desiqn make most . 
three-way analyses inpractical . 

^Ihe Data-ltext- packaged program for urKeighted-means analysis of 
oovarianoe has been used. An urTwei<^td3 neans analysis was selected 
because the sairple size for a particular program is unrelated to any 
' real properties of the model. Since the nuntoer of children in each 
iiodel is ^a im tber of chance^ thei^e seems no reasc^ to give greater 
weigJit to modelaf wliich h^jpen to have more. (;iiildren. 

Covariates/on these analyses include: age, se^r race, preschool 
experience, incoDe, arid family size'. * Pre-test score is included for 
post- test analyses but not gains analyses . . , ' 

Mditsional informatiiDn ph the sanple and analysis is given in 
i^ppendix C. . ■ , 

-^The "Xise of raw gain scores is currently in disfavor because of thfe . 
problems deriving from unreliability of instrutrents—in particular 
regression-to-the-mean effect. The' use of the post-test scores, 
adjAosted by pre-test, is generally considered to be more satisfactory 
because it bypasses the regression prcblen. A strategy vrfiich 
includes; the use of gain soores adjusted "for covariates is used for 
reasons related to the design of the PV 3±udy. Because Pltored 
Variatioi^ is. not a true.ie:}qperim9ntal desian', witH random assign- 
/rent of sites to sponsors,, certain variables are (xmiounded with 
TToiel '(see Smith ,o 73) . 'in consequence/, in the preliminary analysis 
deScrii)ed ixy Part I,"\it seems necessary to adept a conservative 
strategy: we. use two b/p^s of analysis for each test and liioit hypo- 
theses to occasions where two strategies — or else effects on two^ 
instrument's -r-shcw a measure of agreement. ^ \ " - - \ 

3^ause iii'Part I results of gain score, analyses cppear similar 
•to. results' of post- test analyseis, the gain scores 'are not used af 
^ all in Part II. TeGhniqiies..enployed on tiie 1970-71 dat-^a are 
'described in- the intrxDciuction^ to Part II . 

•"^Fpr one child variable, age, a somewhat ^different ^proadi is ^ 
taken. Details are given in Section IV. "^^^^ I' 
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Because the purpose of Port I is tr^generate hypotheses ^ the 
y pattern of ijiteractions is e>q:)lored even vs^iere the overall interaction 
does Jiot reach acceptable levels of statistical s^i^rtificanoe. In 
general, the results for the |our different* dependent Vcij^iables are 
examined, together, and vv^^iere t^vo or more "analyses' shav substantial and 
conpatible interactions bebveeh the var^iable and a particular model,. 
i\ hypothesis is propQsed. Hus criterion is based on the assunption 
'tliat interactions \vtiicli shew up "in only "one analysis are less likely 
tg reflect strong effects, and in conseq^jence less likely to be 
rej^licatcd; it is, however, scfrevAiat arbitxary. 

The rest of Part I is divided into eight sectioi^. Each of tiie 
first seven explores the main dffect of one of the seven variables 
listed above and possible interactions of this variable with the eight 
models of preschooling. Ihe fonrat of these sections is similar: 
eadi lx:?gins with a brief description of tine variable, follcwed by^ a 
sunmary of selected researdi which bears on tliis varia]jle ajid its 
poss^lc interactions V^th program typc^ A third subsectioi^ discusses 
' results of analyses of tine 19.69-70 PV data as they relate to this 
variable. Finally, hypotheses ^relating to tlie variable are proposed>. 
'H'fe hypotheses fall into two categories: strong and weak; Strong 
hypotheses are those grounded in earlier research and sip^rted by 
results of the 1969-70 PV analysis • Vfeak hypotheses are <bf two types: 



scene are generated enpirically from the data with little 



6r no 



grounding in previous research; others are based on Xho fjindings of 



moaning JXi 



•'■Strictly speaking, "statistical significance'* has little 
^'^^e context of tJie W study, ^.since the cisbunption of rancjian cissicTnm^nt 
CD ir"" violated (See Smith, 73) . In this report, the term i$ used nxuicly 
ys^isB a heuristic, to indicate the nugnitude of/ effects. 
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earlier studies but are ^unsubstantiated by tlie first round of 
PV data. 

Hie final section presents a suimary list of hypotheses discussed 
in the preceding pages. ■ l^is section re-examines the' three questions 
raised- in the ^troduction ajM proposes hypotheses relating to these 
^ questions. ^ 
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INITIAL ABILITY 



It -seems reasonable to suppose that soie educational approaches 



will produce their largest gains with children of high ability, vx^ile 
others will be most successful with the less able. For this reason 
it is of interest to corpare the cognitive gains of childrpn of hi^ 
and lav initial IQ in different models. There are, however, methodo- 
logical difficulties in such conparisons: the regression-to-the-mean 

effect will artificially inflate the gains, of children" wiic:) score Ic^ 

_ ' .J 

on the initial test, while deflating those of high soorina diildren. 
This regression effect has two aspects, one of which is statistical 
and til ^ other of'v^icii is "real". 

Statistical regression is related to the reliability — or, more 
accurately, the unreliability — of the test used; for a perfectly 
reliable test {one for whidi pre-test score perfectly predicts post- 
test score) statistical regression poses no problera. Hcwever, for any 
test witl-^ a reliability of less than 1.0, random errors affect the 
precision^ of thfe score. Assuming no systeiiatic bias exists, half 
these errors will lower children's scores, v^ile the other half will 
raise them. If we lock at the diEferehoe between pre- and post- test 
means for the v^iole population, chese errors will balance out and the 
mean gain we observe ^ill be tac^ s.am? as the real gain- If, however, 
we stratify the population accx'/Cing to initial test scores, dividing 
the children into, say, "high" "low" groipss*; our low groip will 
^ probably include more children --vose scores have been artificially 
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c3epressed by testing errors, ;*Lile bur high, groi?) will include a dis- 
prcportion^b^ nurrber of children ,v^ose scores have been inflated.' 
Assuming that at post-test the errors are once again randomly 
distributed, the bottcan group will appear to gain (even if no change 
at all has occurred) >^ile the top groijp will ^^pear to lose Relative - 
to them. Ihe greater the unreliability of the test the stronger this 
effect will be. 

Ihere are several ways to deal with the prdDlem of statistical 
regression. The first is to use one test to stratify and a second 
test to .measure gains. This technique will reduce regression error 
to the extent that errors in the two instruments are uncx:>rrelated. 
In dealing with 'the PV data, I have stratified, children according to 
initdal scores on the Stanford-Blnef and then oompared the gains of 
higfi' and low IQ groups on another test — ^.the PSI. Vfe expect that errors 
on these two measures are as close to uncorrelated as is possible, 
since the tests are given on different days and ^y different testers. 
When this procedure is^ used, any unreliability in the initial IQ test 
score will tend to reduce differences between the groi:ps, since it 
will lead some children whose "real" IQ scores are hi^ to be classi- 
fied as lpw,> while others, cure really low> will be misclassif ied 
as high. This, however, will not basically distort results; it may 
lead to a more conservative estimate of the effect of initial IQ 
^Gn gains. . 

The second way of dealing with thie problem of statistical 
regressiOTi is to" oonpare^ the* standard deViatioa (SD's) of two groips, 
rather than the gains of high and low sooring childri^. The standard 
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deviation is here considered to tie^ an index of the spread of scores; 

» 

we would expect that if a program is systeiTiatically more effective 
in raising the scores of initiaily lcv;-scoring children, then post- 
test scores would be closer to the mean than pre-test scor-es. Con- 
versely, if the program is most effective with initially high-scoring 
children we would expect the range to increase. This increase^ or 
decrease in the spread of scores will be reflected in a parallel 
change in the standard deviation if 'the reliability of the test 
romains unchan<^/ed and if scores are normally distributed. If we have 
ix^ason Lo believe Lliesc conditions are met, we may therefore make sane 
(cautious) inferences by corparing pre- and post-test SD'.s. 

These two tactics are helpful in separating statistical regression 
from any relation between "real" IQ and gains. Hc^ever, the word 
regression is often used in preschool studies to describe a second 
phenonenon: the real tendency of children's measured IQ to rise 
during the first year of an effective treatment and then level off. 
'flius, a group of children who have made spectacular gains in the 
first preschool, year (as, for exanple, in Wfeikart's oariparative study) 
ore expectcii to "regress" during the second year of the program. 

T!iis does not usually meain that the researchers believe the 

M- . ' . , 

first-year post- test systematically inflated children's scores, but 
rather that the firsr yf=^ar of preschool appears, generally, to 
pro^^de a larger inpetus to intellectual grcwth than subsequent " 
school ej^rienoes , and that children have made very large gains 
do not generally maintain the rate of grpwth relative to a national 
population of children of the same age. This phenornsnon ^is real ' 
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enough, and worth bearing in mind, but in the interests of clarity 
it might be better idehtified by anotlier name than regression, , 
l*ien I use the term regression in this report, I refer only to statis- 
tical regression. 

Previous Research 

Most studies of pre--sdriool achievement do not present data which 
permit us to corpare the relative gains of high and low scoring^ child- 
ren and have cc^lete confidence in our conclusions, Vkien the 
researcher stratifies students according to initial scores and corrpares 
mean gains of the resulting groips, we find it difficult to separate 
regression effects from "real" differences. Cjorp^ing pre- and post- 
-test SD's gives us saTiei>*iat more information, but in order to inter- 
pret the r^sul1;s of thes arisOns we must assure that test relia- 
bility remains unchainged and that* the shape of the distribution is 
nearly the same at .pre-'test and post-test. We cannot, of oourse, 
be certain this is true unless we hkve examined the data. 

■ It would be- justifiable .to ignore data reported by other 
researchers and limit our^ inquiry f j an examinaticai of ttie EV data . 
Hwever, it does seem desirable to'oonpare FV results to those of 
previous research Vi^re this is possible. I therefore include 
results reported in other studies here where the likelihood of these 
results being, misleading seems snail. 

If we look orily at IQ data, the chances of the assurrptions " 
concerning distribution and reliability being met are cpod. According 
to the PV reliability study (Walker, Bane and Bryk, 1973) , the relia- 

c 

bility- of this meeisure changes very little with pre-school experieiico . 
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A very slight increase in reliability from pre-test to post-test, is to 
be e^qpected due to the childrBn's increased age. The shape of tiie 
distribution is harder to deal with: without seeing the original data 
we cannot be absolutely certain that the distribution remains 
unchanged. Hoyever, we do know that floor and ceiling effects, which 
are often observed on achievement tests, do not occur on the IQ due to 
the construction of the instnirerit. We also kncxv tihat IQ scores do 
tend to be nonmlly distributed-. In the PV 1970-71 a practically 
distribution- free test (Neinenyi, 1969) has been used to test hypo-' 
theses of no difference in sjyread for eacn ntdel, pre- and post-, on 
. the PSI and the Stanford-Binet. Althougli both tests show seme differ- 
ences in distribution between pre- and pos-t-test, results for the 
distribution- free ccnparison are' the same as results for the sijiple 
Gonparisori of SD's. These results suggest that the test is not 
terribly sensitive to small changes in the distribution such as are 
likely to occur on the Stanford-Bxnet. Nonetheless, we have obviously 
to be cautious in interpreting differences we observe, 

•The study by Kraft, Fuschillo and Herzog (68) of a two-year 
traditional nursery sdiool program in Washington, D.C. illustrates 
the" misleading potential of stratifying by IQ and th^sn corparing 
gains of high and IcJw scoring groips* An appendix to thiS study shews 
the lowest^ grouf) (initial IQ less than 75) gaining 23*i IQ points 
during the first year of the program; this is ooirpared to a gain of 
4.6 points* for the hi^iest groip (initial IQ greater than 94) . 
The author infers, not surprisingly, that *the neediest children have 
benefited most. However, carparison of the varianoe in IQ scores 
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at tlie beginning and end of the first year reveals that, far from hav- 
ing decreased; the variance has increased slightly (not significantly)." 
I conclude from this . fact that the reported dttf^ences between the . 

gains of initially high and low-scx)ring groins are due in lax-ge part 

. 2 , 
to regression. » \^ 

In Erickson's Kalairazoo (69) study, whicli oonpares the effects 
, of a Bti^reiter-Engelmann program^ a traditional program, and no pro- 
gram at all, the standard deviations of. the IQ scores of both preschool 
groups are \vell above that of the control gro\:p at the end of tl:ie ' 
first preschx:»l year (no pre-test scores given; random* assignment of 
children* among the three groips) . . The difference in Vcurianoe between 
tlie Bereitfer-Engelnann and control (no preschool) groips is signifi- 
cant at tlie .05 level; the variance reported for the traditional pre- 
sdiool group is nOt significantly different from those of Bereiter- 

-T 

r^ngehr^nn or cpntrol groups. For control children kindergarten is^ 

— i - . 

"hliese results are puzzling, since the usually-high reliability of the 
S^anforxi--Binet would liot lead us to e>^)ect a regression effect any- 
where near large enou<^ to e^^lain these results. Hov^aver, analysis 
of 'the 1970-71 PV data does suggest that the relation between fall 
and spading IQ score is different for younger and older children, with 
the corprelation between pre- and post^'scores being especially weak 
for youKg children. Children in the Kraft study are nearly a year 
• yoijnger jat tiine of entry than the youngest children in the PV stuj*/, 
c Therefore these odd results may siirplji^ef l€2ct the great diffioulties 
. of obtaining a reliable test score' for very young children • 

The reliability of the test may have changed between pre- and post- 
test but if it did it is likely to have increased (it is sli^tly 
easier to ^obtain a reliable score for children vsdio are older and 
for those with prior preschool e^^perience (See Walker, Bane and Bryk, 
1973) . An increase in reliability would be e3<pected to decrease 
the SD, not increase it, so reliability changes probably do not 
e^lain reported results. 
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the first school experience; for the group entering the Bereiter- 

EngeljTiann kindergarten the variance in scores increases as does the 

nean IQ. For those attending the regular kindergarten the mean IQ 

and the IQ vciriance decreases scne^at. These results may suggest 

that when the first preschool year raises IQ scores substantially it 

is likely to increase the spread ^of children's scores. 

David Weikart's (72) carparison of three preschool curricula — 
> 

his cwn cognitive program, a Bereiter-Engeln^nn model, and a tradi- 
tional program^ — shews dramatic increases both in mean IQ score and in 
IQ variance between the beginning and end of the first preschool year. 
It is interesting that the variance in pos,t-test IQ scores of the 
traditional groip is consistently below that of control groups (nx^ans 
and standard deviations are given for two oontrol groups in Weikart, 
70) while that of the cognitive groip is consistently above that of 
control grovps. These results suggest that Vfeikart's cognitive 
program tends to increase the spread in IQ scores v^ile the traditional 
program—more than no program at all — acts to decrease it. However, ^ 
I would interpret these data very cautiously for two reasons.. First, 
the exceedingly smaiXl SD's reported at pre- test, and the increases 
reported for contrast as well as preschool groups, suggest that the 
dianges nay result in pcirt from the initial selection prcxjcss (aily 
"functionally retarded" children) . Second, tlie pre-tost mean for all 
groups is so lew — ranging froifi 73.0 to 84.4 — that the whole gifoup 
may be considered equivalent to lew IQ groi:5>s in other studies. 

Van de Riet's (72) evaluation of Sprigle's Leaming-to-Leam 
program ooitpares the IQ scores of four and five year olds before and 
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after participation in tvso preschool programs, one experimental and 
one traditionaH. For both groups of children in traditional programs 
(a nursery day care center and a Title III kindergarten) tlie standard 
deviation of scores ijicreases markedly; in the case of the kindergarten 
childreji this pre-post difference is significant, Pre-post differences 
for the two experimental groups are sn^ller and insignificant; for the 
four year old group the SD actually decreases • 

Hodges, Spicker, and McCandless (67), oanparing gains of /^pala- 
chian five-year'-olds enrolled in a structured e^q^erimental preschool, 
a public kindergarten, and no program at all, report no significant 
relation between gains and initial IQ for any groi:p (standard devia- 
tions not given) . 

TliGse data from preschool evaluations suggest tliat successful 
preschool programs, whatever tlieir curricula, do not generally decrease 
the variance in IQ significantly, at least for first-year children. 
On the contrary, where a significant change in variance does occur it 
is generally an increase. "In all likelihood this means that IQ gains 
are eitlier uncorrelated with initial ability or that children of high 
ability are gaining irore. Ihe preschool data do not suggest that 
certain tyf)es of programs consistently increase the variance more than 
other programs. Althou^ both Weikart (71) and Erickson (69) report 
hi(^er post- test SD's Bereiter^-Engelmann than fof: traditional 
programs, in'nei^er case are the differences significant* .Uiere is 
some suggestion, from David We^ikart's bonparative evaluation (T^lkart, 
71) , that his. cognitive program may increase the variance in IQ 
scores more than other pre-school programs. 



Two sources might ha\^ led us to expect 'different patterns for tra 
ditional and Bereiter-Engeliaann prograirts. The first is Bissell's 
re-analysis of the data collected by Karnes, DiLorenzo, and WfeiJ<:art 

(Bissell, 70). Bissell finds an interaction between program, and SES, 
with the higher SES children gai.ning more tl^an lower SES children in 
' "enrichment" programs and the lower gciining as much or more than the 
higher in "structured" • programs (Bereiter-Engelmann and Kani^' An^lio^ 
ration program) . Since for neai:ly all programs the prescores she 
reports for lew SES children are lower than those of the highest SES 
groip, we might e^q:>ect to find a similar pattern for initial IQ; in 
tlie terms of the present discussion this would lead to the - expectation 
of a decrease in tl^e variance of IQ scores for children in Bereiter- 
Eiigelnvinn programs and an increase for children in traditional pro- 
grams; tliis expectation is not confirmed. 

Ihe ^titude- treatment-interaction (ATI) studies relating to 
general ability wuld lead to a similar expectat,ion , although the 
relevance of these studies to PV models oould be questioned. Bar- Yam's 

(69) review of that literature sunmarizes three studies (Wispe, 1951; 
Calvin, 1957; Ward, 1956) reporting an interaction between teaching 
Style and student's ability. In all these studies students of low 
ability achieved more in "directive" than "permissive" classrooms. 
In general, the curriciiLum made less difference for the students of 
high ability, but when the measure was understanding rather than recall 
the brighter students did somevdiat better in the "permissive" 
environment- 
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One reason for questioning the pertinence of Bar-Yair.'s "directive"- 
'*^rrlssive" continuum to Planned Variation models is^that in these ATI 
studies th^ class worte* as a unit in both the directive and' non- 
directive treatnents. In the directive method the teacher takes all^ 
of the responsibility for raising questions and presenting mterial, 
while in the non-directive method students take some Qf it. However, 
in the less--directive PV models nost teaching is done either on a one- 
tjo-one basis or in very snail groups , not in large student-directed 
classes . Researcii in the "discovery method" 'would be some^at more 
relevant^ but investigators studying --''discovery" classrooms have not 
generally used ability to categorize students. 

For all these reasons plus some others — the age of the students, 
the c-utoomes 'sought — the ATI literatiire ifes limited application to 
the PV study. Hcwever, these studies do illustrate the direction of 
thinking among researchers have considered possible interactions 
between classroom practice, intellectual ability, and achievement. 
One purpose in examining the 1969-70 data is to see to what degree and 
in vrfiat ways the hypotheses and distinctions of this literature are 
relevant to PV models^, 

1969-70 FV Data . * 

Conparison of the standard deviations in pre- and post~IQ scores 
reveals that, for the PV saiiple as a v^ole, and for each individual 
model except Vteikart, 'the SD's decrease between fall and spring testing. 
For the sanple of all children in PV classrooms, this drop is 
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significant (p < *05) , but for most individual models it is not, due 
to tlie smaller N's. The exception is Gordon, v^ere the decrease in 
variance is significant (p < -05)^ Ihe. variance in IQ scores also - ^ • 
drops for corrparison children (children in unsponsored Head Start 
c].assrooms) but the drop is considerably smaller and insignificant. 
Were ^this not the case we mi^t conQlude that the pre-pc^t variance 
changes result merely from an increase of test reliability. However, 
tlie difference between PV and corrparison sairples indicate that this - 
explanation is inadequate. ' ^ ^ . . 

Table la gives means and SD's pre- and post- for all models. ; • 
For the Stanford-Binet these figures are given first /or all children 
in the model and then for those without previous pre-schooling. The 
pre-post SD's are oonpared both ways on the theory, that the drcfp ih * 
SD's might- merely reflect first-year children catdiing up with those 
having previous preschool experience. However, this appears not to 
be tJie case : th^ decrease is no less for the group .of children with- 
out previous preschool ing than for the sanple as a wiiolo. 

The PSI also shows SD's decreasing acrxJss models. These results 
suggest that for both te^^ children who initially score lav gain 
more than those \^^lo score high. They are surprising inasmuch .as 
programs stixiied by other researchers have shewn a tendency to increase 
rather than decrease the variance of scores d^first-year children. 

• For furthei" ?rxalysis of the PSI data, children have been divided 
into two groups on the basis of their fall IQ scores, the "hic^" grovp 
consisting of children initi.ally scoring abcr/e the sanple mean {92.5 
points) , and the "lav" group of children scoring belov it. 'flic 
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unweighted means analyses of covaxiancs reveal significant rrBin effects 
for if^itial IQ. 'As expected, these effects -^avor low IQ children for 
PSI gains (p < .05) , the differeJice between the adjusted mean gains • 
of high and^^lo^ scoring dtildren being 2.702 points^ For the covaried 
post score tlie main effect (p < .001) favors high IQ children, witli 
the differenge in adjusted post- scores being 3.998 points. fVidently, 
104 IQ children start Icwer, gain more, but still end up lower. ' 

The nodel'-by^IQ categcr^^ interaction is significant (p < .05) for 
analysis of PSI gains but not for the PSI post- test analysis. 
Interaction effects are coirputed after the main effects of model and 
IQ category are taken out; they refer to the wi thin-program effect of 
the IQ category an adjusted (covaried) scores or gains. 'Ihus, for the 
Tucson program the difference between the adjusted PSI post-test 
scores of hi^ and low IQ groips is 8.068 points. Of this difference, 
3.998 points is accounted foj: by the main effect of IQ. This leaves 
a 4.070 point difference to be e3<plained by an interact3:c^r:<itxIQ cate- 
gory and model; this interaction effect is expressed (see upper- right- 
hand cell of Table lb) as ±2.035. 

Table' lb below gives the magnitude and direction of all^ inter- 
action effects greater than +1.0 points for^both analyses. This cut-- 
off is chosen arbitrarily, as a heuristic. ^+1.0 points expresses a 
difference of 2.0 points between adjusted post- test scores — .20 SD*s 
on the Stanford-Binet, and .17 SD's on the PSI. 

The 69-70 data suggests that across programs there is a tendency 

1 . ■ V 

. for children of lew initial IQ to gain more than those of 'high initial 
IQ both on the PSI and on the Stanford-Binet. It suggests that tliis 
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Part I 
Table Bd* 



Analysis of Covarianoe Interaction of Initial IQ Category with Model: 
Adjusted Interaction Effects Greater than 1,0 Points** 

1969-70 PV Data 



I?ositive for Positive for 

low IQ children . high IQ children 

(initial IQ < 93 points) ^ (initial IQ > 92 points) 



PSI^ 




Weikart 


(+ 1.136) 


Tucson (+.2.0 35) 


Post-test 




■ 










Gordon 


(± 2.047, 


Bank St. (+ 1.122) 


PSI Gain . 


. / 


Vfeikart 








. ■(+ 2.605) 


Busi-iell (i 1.042) 










Bank' St. (± 1.568) 






Gordon 


{+ 4.643) " 


Tucson (+ 2.952) 


-». 








EDC (+ 1.41) 



*Sanple: all children with valid scores on PSI, fall and spring. 

**Ihis means that with the nain effect of previous preschooling- taken 
out the difference between adjusted nBans is greater than 2.0 
poxhts. This amounts to one-fifth of a standard deviation on the * 
PSI and one--sixth of a standard deviation on the Stanford-Bine t. 

Covariates include age, sex, race, preschool e^^x^rience, inoone^ ■ 
and family size; pra-test fecore is a oovariate in the post- test 
analysis. All 'models are included in these two analyses. 
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tendenQ' is strongest and irost cx>nsistent in Gordon sites. Beyond 
this, it tfffers some si^^port to the ATI hypothesis chat less-directive 
prograuB are nore favorable to the achievement of ligh ability students 
than to that of 1cm ability students: the progranr« sho^^ing consistent 
effects of same magnitude favoring high IQ children for the PSI are all 
on the less -directive end of the continuum — see Table lb, right-hand 
side (Bushell does show up in the leaver-right-hand. cell, but not in 
the upper ri^t) . 

The results for the Weikart program are contradictory and sore^at 
baffling. The IQ data suggests- that this may be the only PV model to 
increase the variance in IQ scores between fall and curing testing. 
This fits with Weikaxt's cvm data (Weikart, 72) v^^iich shows the vari- 
ance in IQ scores for children in his cognitive program rising signi- 
ficantly and dramatically during the first preschool year. The PSI 
data, however, shows an effect favoring the achievement of low IQ 
children — the exact opposite of what the IQ data would leai us to 
expect. 

If this contradictory pattern were to be repeated in the 1970-71 
data we would be forced to see it as resulting from differences between 
the two tes.ts, saying in effect that this model increases the spread 
of IQ scores but decreases the spread of achievement. But until such 
an interpretation receives support from anotHer round of data, I would 
give greater weight to the IQ data because it follows the pattern of 
Weikart 's earlier study. 
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Hypotheses 
Stron g 

' 1. Le^ active models 'will sho^ interaction^ favoring diild 

ren of high initial IQ on the PSI post- test. 

Hie ATI literature suggests the hypothesis that in -less- 
directive ("perrrdssive") environments, children of low 
ability will be at a disadvantage. Ihis hypothesis is 
supported by ""the 69-70 data. 

2. Vfeikart programs will show a stroiger tendency tlian other 

programs to increase the variance of IQ scores. 

This hypothesis is suggested by Weikart's ccnparative 
evaluation data (Vfeikart, 72) and supported by the 
€9-70 data. . 

Weak— Based on 69-70 PV Data 

3^ In Gordon programs within-model interaction effects on the 
PSI will favor diildren' of low initial IQ. 'Ihe variance of 
IQ scores will tend to decrease in this model- 



/ 



Y 

11. PRiyiOUS PRESCHOOL EXPERIEE^JCE 

>Both in 1969-70 and in 1970-71, the Planned Variations sarrple 
includes a number of c±iildren with sane prior preschool e^<perience. 
Although the PV study does have infonpaticHi on the duration of tliis- 
preschooling, and whether or not it -was Head Start, the, stixJy has no 
data oonceming the character of this experience — ^^^lfet^ler the. program 
was highly--directive or not, vyAiether the orientation v/as academic, 
emotional, or sinply custodial. It is therefore unfortun^ately 
necessary to lunp together all prior preschooling, even tJiougii diild- 
ren's e;<periences undoubtedly differed in iirportant ways. 

In the 1969^-70 PV sanple, children with prwibus preschooling 
score higher on the Stanford-Binet pre- test than children without it. 
For the entire 69-70 sanple, the magnitude of this difference is 5,4 
points. As'We might expect, ho/ever, the raw gcd_ns of the children 
vjithout preschool experience axe larger; so that post- test differences 
between the two gro\ps are considerably smaller. 

Hie relatively snail IQ gains made by PV children in tlieir second 
year of presdiooling are not particulcurly surprising': 6ic data tra^ 
most other evaluations 0t two-year prograne follow, a similar patte. 
{see, for exanple,. Gray and Klaus, 1968; Kraft, Fuschillo, lierzog, 
1968; Beller, 1969; Erickson, 1969; Kame^, 1969; Weikart, 1971; Van 
de Riet, 1972)."'' "Even in Beller's study, which is remaricable in 

■^An interesting exception to this rule is thp control groip in Van de 
Riet's study (72) . Ihis group made no IQ gains in a year of a tradi- 
tional day' care program, but made significant gains in a Title III 
kindergarten the following year. Ihe other control group, without 
previous preschooling, showed no IQ gains in the kindergarten • 
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reporting significant IQ differences between children with one and 
two years of preschooling v^ich are maintained as far as third grade, 
kin^^ergarten IQ gains of children with nursery school experience are 
very small. 

^Ihis dods not mean, hcwever, that the effect of a second preschool 
year on children's test scores is trivial. On the contrary, as Mar- 
shall Smith (73) has shewn in his report' on the 1970-71 PV data, even 
children with prior preschooling show gains two to three times as 
great as those we would expect to observe for a ccnparable group of 
cl^ildren not enrolled in preschool.'^ Ihis is true both on the PvSl cind 
on tliG Stanford-Bine t< ' , 

From w^iat we know about the enphases of .different models, it 
seems reasonab,le to guess that sccve programs may be especially 
effective in boosting test scores of children who are entering pre- 
school for the first tine. Other programs — perhaps those v\rtiid> plaoe 
a high value on fostering diildren's initiative — mic^t be soinswhat 
more successful with second year diildren. I have therefore asked 
two questions conoeming the pattern of second year gains. First, 
are some models more successful than others in producing cognitive 
gains for children with an earlier preschool experie-noe? Second, 
do some types (or categories) of children ,gaih more tlian average 
from a second preschool year? 

This finding is explained in M»S. arrdth, Sore Short-term Effects 
of Project Head Start; A PreliiTUj:ary Report on the Second Year of 
Planned Variation > 1970-71, Huron Institute, January 1973. 
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Previous Research 

The' effect of curriciilum on second year gains . The design of 
the Kalamazoo study '(Erickson, 1969) makes it possihle to study the 
relative irrportance of first-y^ar curricula, second-year curricula, 
and the match bettveen the two. Children in this study were randomly 
assigned to three preschool treatuBnts: Bereiter-Engelmann , tradi- 
tional, or naie (a control group) . After one year of preschool, half 
the children in each group were assigned to a Bereiter-Engehnann 
kindergarten and ^e other half to a traditional kindergarten. The 
IQ scores at the end of preschool and kindergarten are given beloiv 
for each coirbination of school ejqperienoes . 

Table Ila shews a strong main effect of first year curriculum on 
second year IQ post-score; this effect favors ciiildren from the Ber- 
eiter-Engelimnn preschool. Ihe main effect of second-year airriculum 
is insignificant. However, the interaction of first and seccnd year 
curricula, taken in conjunction with firs€ year curriculum, is 
significant (p < .05) according to Eridcson's regression analysis. 
Table Ila indicates that childreij in each preschool group benefited 

more from a kinderga^rben experience vv^idl was unlike their preschool 

' * 1 
than fran one that was like it. 

Mho gains most =from a second preschool year? The IQ data 

reported by Kraft, Fuschillo, and Herzog (68) for 

^Wo other studies (Karnes, 1969; Pfe±kart7 1972) coopare the IQ gains 
of children in several types of preschool program bver tjwo years. 
However, because children were in the same program both years in these 
two evaluations it is iirpcsssible to separate the effects of first and 
second year curricula on second year IQ gains . 
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Table Ila 
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Stanford-Binet Scores for Children in Two Types of 
Presdiool and Kindergarten Program 
(Adapted frcm Erickson, 1969) 



Preschool Curriculum 





Bereiter- 
EngeliTBnn 


Traditional 


Control 


IQ at end of preschool 


136 


138 




N 


108.1 


105.7 




S.D. ■ 


17.9 


16.7 




IQ at end of traditional 
' kindergarten 


30 
111.7 


28 
100.6 


29. 
91.5 


S.D. 


13.89 


13.52 


9.33 


IQ at end of Bereiter- 
Engelinann kindergarten 


30 


28 


29 


. , N 

t 


• 108.7 


103.2 


. 104.9 


S.D. 


13.36 


13.07. 


16.53 
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children attending a two year traditional hursery school program in 

Washington, D. C. indicates that (^fferent children may benefit during 

the first and second years of preschool. For their sartple, the prdoa- 

bility of a child's making "significant" seccaid year IQ gains (they 

define gains of five points or more as significant) was nearly twice as 

great if he had not irade such gains the first year as if he had.*'" 

The Kraft data also suggest that, at least in a traditional 

nursery school program^ children of low initial IQ (where "initial" 

refers to IQ at the beginning of the first year of preschool) may 

iTBke greater IQ gains during the second prescht^l year than children 

of high initial IQ. Kraft et al. report second year gains averaging 

7.6 points for the groip with initial IQ's of less than 75 and an 

average loss* of . 2 points for children v*iose initial score exceeds 

94 points. These differences cannot be attributed sinply to 

regression error, sjnce the initial IQ on whiqh children are classified 

3 

IS not one of the two IQ scores used. in corrputing second year gains. 



YR 2 Gains 
Yesr- No . 



Yes 
No 



7 


16 


7 • 


5 



Adapted from table on p. 71 in 
Kraft, Fusdiillo and Herzog. 



YR 1 
Gains 

2page 76. 

Children were tested the sijwmer preceding the first preschool year, 
during May and June- of the first year, and during May -and Jxjne of 
the second preschool year. The first test was vised to classify them 
according to initial IQ; the second and third were used to calculate 
second year IQ gains. 
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The data reported in Erickson's Kalamazoo study suggests a" simi- 
lar pattern. Althou^ gains are not reported in terms of initial IQ 
strata, inferences about v^at group has gained most frcm the second • 
preschool year may be made by conparing the variances in IQ scores at 
the ends of the first and second years^ If children v/ho scored high 
-on the earlier test have gained more than those initially scoring lav, 
the variance would increase. If, on the other hand, the children who 
scored lower on the first test have gained more, the varianoe would 
decn^ase. For both preschool groups, the variances in IQ scores 
reported for the end of the preschool year are significantly higiier 
tlian tliose reported for the end of the kindergarten yecir. Ibis 
suggests that in both types of kindergarten, second year children of 

\ 4^ 

lew IQ made greater gams than those of higher initial IQ. \ 

One mi^t guess from these two studies that diildrsn of high 
ability adjust more quickly to preschool than those of Tow ability and 
in consequence make somewhat greater gains during the first preschool 
year (as noted in thte -section on initial IQ, .most studies shew SD*s 
increasing between fall and spring of the first preschool year) . It 
is possible tliat becai^e of their larger first year gains tliese hi<^i 
ability children are less likely to make second year geiins;^,the cliild- 
ren of lew ability, on the. other hand, -my have taken longer to adjust 
to presdiool and make large g^ins only in tiheir second year. 

, Karnes, like Kraft, reports IQ gains by initial IQ strata as 
well as by program. In the Bereiter-EngeLrann kindergarb^, children 
of Icw^and average initial IQ ("initial" referring, ,again, to the score 
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corputed at the beginning of the first preschool year) gain consider- 

r 

ably more during their secxnd presdiool year than childr^ scoring 
relatively high ^t the beginning of preschool,"'" Ihe significance of 
these differences can not be evaluated )Decause SD's are not reported. 
No oonsiStent differences between strata exist for the foijcr groups 
attending public kinderga^rten . 

Van de Riet's evaluation of Sprigle's "Learning to Learn" 
Program (Van de Riet, 1972) suggests that a second presciiool year may 
actually have a long term effect on the variance in IQ scores. Van de 
Riet reports thaV although the mean IQ score of the children with one 
and two years in the experimental preschool program does not differ 
significantly by the end of grade 2, the standard deviation of the 
scores of the group with two years of preschool ing i^ considerably 
(and significantly) smaller than that of the group with only one year 
of preschooling. 

Kraft et aJ . suggest the possibility of a second-order interaction 
between socio-oconomic status, program and previous preschool exper- 
ience. Signifi.vcance levels are not given, and the nunbers are snail, 
but, again, the data is suggestive; Table lib belcW, adapted from 
their presentation, shovs^ the proportion of children at each SES level 
rraking c^^ins of five ot more points in the first and second year of the 
traditional nursery school program. Ihe categories are not mutually 

''"Again^ these effects cannot be attributed 'to statistical regression, 
since the initial IQ score used in stratifying the sanple is not one 
of tlie twi used in oon^uting ^second year gciins • • ^ 
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Table- ilb* 



Proportion of Children in Three SES Categories Making IQ 
Gains of Five Points or More (Greater Than One-half a Standard 
Deviation) during the First and Second Preschool Year. 



if 

r 

S 


SES Level 


Adequate 
(n = 8) 


Borderline 
(n = 7) 


_ Povert^' 
(n = 19) 


Proportion 
of children 
making 
gains of 
five points 
or more 


Yr. 1 


« ^ 
• .75 


.72 .. 


,58 


Yr. 2 


.25 


, 

.42 


.53 



tl ■ ^ 

*Mapted frcm Kraft et al . (1968) table on ^ge 76; children classified 
in accordance with incone level categories devised by the Social - 
Security Administration. ' " 
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exclusive: soire children gaimboth years and others make no gains 

at all. . . \ 

Table lib suggests a positive correlation between SES dnd IQ 

gains for the first year^^ldren. ihis is in line with Bisccell's (70) 
■» 

finding that for less-structured programs SES is positively- correlated 

» . ... ^ 

wii±i- gains. Hcweyer, the second'^^ar data reverses this pattern, and 
it appears that - for the second year SES . may/be negatively correlated 
with gains, even in this less -structured presc±iociL- . . * 

In summary, 'the data collected in pr^adous presciool evaluation 



stuox^is suggest the following -hypotheses concerning the cognitive . 

effects of a second year of preschooling and the interaction. of. previous 

preschool experience ' anjd program type: 

l.o In a given preschool program, 'the IQ "gains of children with 
previous preschool ^e35)erienoe are less than thos'e of 
. ..children without such esqperience (all studies).' 

2. Children with a particiiLar t^pe- of preschool e3<perience 
make greater second year IQ gains in a program vAiidh is 
quite different from their - first e^^Jerience than in one 
v^^ch is similar to it 'EridcSon) . ' . - 

3* Children whosei first preschool' experience is in a highly 
structurea program are ihore liJfcely -'to maintain^ or increase 

. . IQ, gains durijig' the Sebbnd preschool year than children 
v^ose first yeab: program' rs less structured (Erickson) . 

' . * '"^ ^ J. 

4. Children makiiitf large IQ' gains in- their -first presdiopl 
year "are less likely to make^sujpstanCial gains during the 
second year^tlian children making negligible gains the 
first i^ear (Kraft,^ Fuschillo, and Herzog) . 

5. Children of 1cm initial IQ are more ^likely than children of 
high initial IQ to/ireke large gains during the second year 
of preschooling (fcraft, Fuschilio, and Herzog;. I<ames; 
"Erickson) . j 

J 6. Children of* low SES are more likely to ''make seciond year IQ 
gains than those of hi^- S?S (Kraft, Fuschillo, and Herzog) . 



45, 



1969-70 Data 

Becaiose specific inforrration on the diaracter of each child's 

earlier presd:iool exporiences is unavailable, nBny of the hypotheses . 

listed abo'/e can not be tested on the 1969-70 data. These data have 

therefore beeja use(3 mciinly to tesi: hypothesis 1 and to look for inter- 

• actions between particular models and preschool G>perience. 

■ To evaluate the significance of interaction effects, twcHway 

analyses of covariance were perfonred on PSI pcst^test scores, PSI 

gains, IQ post-test, and IQ gains. Far Wfest was excluded from all 

analyses, and Bank Street and Bushell from IQ analyses, because of the 

small nunber of diildren with preschool experience enrolled in these 

models^ All four analyses shew main effects favoring children without 

previous preschooling. Ihesa effects are significant only for tiie two 

2 

analyses of gains ,(p .02) . Ihe magnitude of the effect is substan- 
tial for IQ gain, the unweighted adjusted gain for childrcn with pre- 
school' e:>q^rience being 1.1 points, aa contrasted with 5.4 points ^or 
. -those without preschooling (a difference of about one-third of a stand- 
ard deviation) . The difference betwden the bwo groips for PSI gain*- is 
snaller, anounting to only 2.0 points (about one-fifth of a standard 
deviation) • ^ ' ' 

•'"See Introduction, page 16 for covariates and general methods. 

2 ^ ^ ^ 

^In other words, dvildren with pr-^or preschooling Qain less , on the 

average, than those without, bat the difference between the two 

groips becomes insignificant vjhen ofce controls for irp.tial score. 

^patently children with prior presgiooling gain less only to the - 

ejctent that they start higher. 
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Ihfe interactia. of preschool e>qperieiioe and model is significant 
above^the .05 level only in the PSI gain analysis, but approaches 
significance for the other three analyses. Table lie shows the size 
and direction of interaction effects for the four or^alyses, ^ere the 
imgnitude of these effects is greater than 1.0 points. It is important 
to rernember that prograiie listed as shaving effects positive for diild- 
ren witli previous preschooling (left-hand side of Table lie) do not 
necessarily shew larger adjuste.^ aains for these children, since tiie 
maxn effect of previous preschool e)<perience has been taken out. Thus, 
children with prBSchool experience in Engelmann-Becker sites actually • 
gain less on the Stanf ord-Binet than those v/ithout such e:>5>erienoe , 
but because the difference between^ the two groups is 1.3 points, as 
contrasted with tjae 4.2 points for the entire PV sanple, it is said 
to shov an interaction favoring those with preschooling. 

On tlie basis of Table lie we might hypothesize interaction effects 
favoring ctiildren with previous preschooling in Tucson and Bank Street, 
and favoring children without preschool e5^>erienoe in Goroon and 
Engelmann-Becker. Wfeikart's scheixe for classifying progrcUTB (Weikart, 
72) might be useful in interpreting these observations. It seenis 
reasonable to suppose that in the prograire vrtiich require a gtxxJ deal 

•^dinarily, models vdiich shew contradictors' patterns on the two tests 
are not included in hypotheses. I make an exception in this case for 
two reasons. First, as explained on the previous page,, .the IQ gains ^ 
interaction fa^/oring those With previous preschooling is somsv>^at \ 
misleading — it actually reflects not a tendency of the model to benefit 
these children substantially, but rather a failure to produce average 
IQ gains for diildren without presdvx)! experience. Seccnd, tlie 
effects on the PSI favoring those without preschool experience are more* 
substantial than any others on the table. 

erJc 
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of initiative on the part of tlie child — "'child-centered" progranis, 
in Weikart's terrrB — previous preschooling might be an advantage, v^^ile 
in prograiTTS wfiere the prirrary ^sponsiJoilit:^^ is laid on the teaching 
adults, such experience mi^t be less useful, l^ikart places both 
Bank Street and Tucson in thie "child-initiates" category, and' 
Engelmann-Becker in the "adult-initiates" group. .Although Gordon 
differs iirportantly frcsn all these models, its primary enphasis seems 
to be on the role of adults in children's learning. Ir this it seeins 
to rvsemble tliose nxxfcls falling into the "adult-initiates" gix)up. 

In effect this may mean tJiat in "less-directive" or child- 
centered- programs certain kinds of preparation facilitate cognitive 
gains, while in "mDre-directive" models prepai^ation is lass important — 
pei+iaps even a disaa\4ntage. This result parallels the suggestion 
made in the previous section that less-directive models fciwr the 
achievement of children of high initial IQ. Taken together they 
indicate that children with certain kinds of educational advantage's — 
citJicr prior prescliooling or higher initjLal IQ — may be more likely 
to mike offecti^/e ciioioes in a preschool environment. 

There is, however, another possible interpretation, and it is 
worth bearing in mind. It may be that the choices made by the "more 
prepared" children are sirrply more likely to lead to the types of 
learning measured by the PSI and the Stanford-Binet. It is quite 
possible that the first-year children — and/or those with low initial 
IQ scores — are learning cognitive ski 12^ ^o^equal or- greater inportanoe 

but ones v>rtiich go unmeasured. They may be learning Jticxv to fijid scme- 

i 

thing to do, hcM to scan a room to learn v^t options it offo.t^, hcM 
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to distingui-sh an adult who is free to give help from one who is busy 
or preoccupied, and hcM to tune out soire, but not all, of the noises of 
busy roan; Ihese skills, and a hundreci others liJce them, are not 
measured by the PSI and Stanford-Binet so we don't know who is learning 

m 

them, or in vrtiich models. But it certainly seems possible that first- 
yeeir \children in less-directive classrooms spend much time polishing 
these sk^n^ equally, it makes sense that children who l^x^ssess them 
my, in such anelrrirfOTiment , irake greater gains on cognitive tests. 

Hypotheses 
Strong 

1. 'ilie oognitive gains of children having previous proschoo] 
experience will be smaller than those of childnen having no 
such experience. 

Hiis finding is conrnon tg nearly cll preschool evaluations 
(see p. 36 ) • It is si4}ported by tlie 69-70 PV data. 

Weak — Based on Literature 

2. Children with a particular type of presdiool experience will 
make greater sfeoond-y^ar IQ gains in a program ^ich is * 
different frcn their first experience than in one which is 

. & 

similar 1x> it, 

Ihis hypoUaesis is suggested by iilrickson's IQ data. 

3. Children v^ose first preschool experience yas in a highly 
^structured program will be more likely to maiVitain or. increase 
IQ gains during the secxaid presdiool year than children whose 
first-year prpgrail was' less structvired/ 

Iha.s hypothesis is suggested by Erickson's IQ data. * 
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4 • Children making l^ge IQ gains in their first preschcx)! year 

will n^ke smaller gains during the second year than children 

making negligible gains the first year. 

. This hypothesis is suggested by the findings of Kraft, 
Fuschillo, and Herzog. 

5» Oiildren of low initial IQ will ireke greater gains durijig the 

second year of preschooling than children of hi<^ initial 

IQ. 

This hypothesis is suggested by the data of Kraft, Fuschillo, 
and Herzog, by tlie, Karnes data on IQ gains in the Bareiter- 
Engelrmnn kindergarten, and by ^the IQ variances reported in 
Erickson*s study. * ^ 

G» ChiJdren of Iw SES will make greater second year IQ gains * 

tlvin those of high SES. 

This hypothesis is suggested by the data of Kraft, Fuschillo, 
and Iferzog. 

Vfeak— Based an 1969-70 Data 

7. In Tucson and Bank Street programs, interaction effects on both 
cognitive measures vv^ll favor children with previous pre- 
sdriooling; in Gordon programs, interaction effects will favor 
children without such e>^rience. In Engelmann-Becker programs 
interaction effects on the PSI will favor those without pre- 
vious preschool e:qDerience. 

Tills hypothesis i's based on the 1969-70 Pv data. In a more 
generalize<3 form it mi<^t be stated "child-centered" or "less 
directive" programs will show interaction effects favoring 
second-yeas children while programs where the initiative lies 
primarily ^th adults will show interaction effects favoring 
s first-year children. 
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Differences ^th in fehe^inaturation rate of preschcxDl girls rnd 
boys and in culturally-based expectations for their behavior raise the 
possibility of sex-by-nr>del interactioris . However, contradictions 
in tl-ie research on intellectual differences between boys and girls in 
different preschool programs create formidable obstacles to the genera- 
tion of specific hypotheses about the form of such an interaction. 

Previous Research 

The data on hew (and vvtether) different types of preschool 
programs*' affect boys and girls differently is inoonclusive. As a rule, 
boys score slightly lower than girls on oognitive prc- tests; on the 
Stan ford-Bine t mean differences usually amount to bejtween one and four 
points. We might therefore expect boys to gain slightly more than 
girls ^ due to regression effects. If resear^ers control for pretest 



score the regression effect poses no problem, but unfortunately few 

) 

studies do this. Instead they contrast rav gains for the two groups. 
In oonsequenoe, vd^en jDattems tend to reduce initial differences 
between the scores of girls and boys we cannot usually draw any 
conclusions. . 

Research on traditional nursery school programs shews no strmg 
pattern of greater gains by either boys or girls.- However, in the 
two studies I reviewed which show significant sex effects ;^^ich cannot 
be attributed to regression;, differences favor girls. Hodges, Spicker 
and McCandiess (67) in their work with five-year old T^ppalachian 
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children report insignificant differences favoring boys for all groips 
(public kindergarten, experimental preschool, and controls), Kraft et 
al . (68) also report that boys g:iin more than girls in both years of 
their Hovard University nursery school study. However, both these 
studies use raw gain scores, so it is diffipult to tell hew much of 
the observed effects are due to regression/ Erickson (69) finds no 
difference between the ^^ins of girls and hayz in the traditional 
program he examines. « 

Bissell, in an analysis vsiiich controls for pretest score, SES, 
and ethnicity, reports effects favoring giirls in the "permissive- ^ 
enrichment" prograiTB she examines, Hiese differences are si<^?^ficant 
(p < ,05) in one program and insignificant in the other tt;o,/ anith 
(68) also reports' large and highly significant differences favoring 
girls at the end of a full-year pre-kindergarten program in Trenton 
(IQ differences between boys and girls not yet in preschool- are insig- 
nificant) . Neitlier Bissell's results nor Smith's can be attributed to 
regression. 

Results reported for Bereiter-Engelmann programs are somevdiat 
more consistent, althou^ they do not suggest strong effects: 
Erickson (69) and Bissell. (70) report small differences favoring boys 
in Bereiter-Engelmann programs. Ihese differences are insignificant 
for Bissell 's sample; significance levels are not given for Erickson 's. 

Hiese results suggest three tilings* Firs^, vhen sex differ- 

ences in achievement are found in traditional programs — differences 
♦ 

v*iich cannot be attribi4ted to regression or poor methodology — they 

are likely to favor girls. Second, the magnitude and significance 
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of these effects VN^ill vaxy considerably from school' to School, or site 
to site. And third; sex differences in Bared ter-Engelnann pro-- 

grams will usually be small. . ' . - , 

Ihese patterns seem to .reke sense. Girls ^ apt^arently enter preschool 
slightly more prepared (one evidence of this is their sli^tly higher 
pretesjt scores on cognitive tests) , As I have suggested in previous 
sections , more prepared children may be at more' qf an advantage in 
less-directive models than more-directive models. However, these sex 

• J 

differences are not large. Ill seems entirely likely that in programs 

where guidelines for teadier-cnild interaction are flexible (this 

wquld describe most traditional programs) , teacher e>^)ectations 

conoeming sex differences and sex^appropriate behavior will influence 

'die pattern of sex effects as much or rrore than real differences' 

between girls and boys. Ilenoe we should not be surprised to see the 

magnitude -of sex effects varying considerably from subculture to 

subculture, region to region, and even classroom to classroom. 

♦ 

1969-70 Data - • • 

H-ie analyses of covarlanoe using the four dependent variables 
PSI and IQ ppst-score and gains yield renHrkably consistent results: 
the mairt ef fleet of se^ is insigriificant in all analyses, cis is the 
interaction of sex and model. For the PSI post-score, all adjusted 
interaction effects are less than 1.0 point. Interaction effects for 
IQ gains and covaried post-test score are somewhat greater than those 
observed for the PSI, althou^ still insignificant overall. Conci stent 
effects favoring boys are seen in Far fest and Tucson models; the 



54. 



only model to shcM a consistent effect favoring girls is Bnshell 

(see TAble Ilia) . 

Ihese data support the rBneral impressions created by earlier 

stijdies: first, strong, consistent sex-by-model interactions are 

not to be e^q^cted in analyses of preschool outa'^TBs, and second, the 

rvsdn effect of sex on cognitive outcomes is very small. 

Ihe 1969-70 PV data suggest that when testers and children are 

drawn fiom a variety of regions and subcultures , differences in 

response style, as defined by Hertzig-Birch codes, are almost totally 

1 

uncorrelated with sex; this may, of course, be untrue for particular 
classrooms, sites, or testers. Similarly, the overall correlations of 
sex witli pre- and post-test scores on the cognitive maasure i^^ low, 
ranging from .075 to .165, althout^ in particular sites it goes 
higher. 

I think these daJsarSugges^ that v^ere mai>> effects of sex or sex- 
by -model intetactioms seem strong they ip^y have been created by parti- 
cular local atbi^tudbs or teadiing p2?actices rather than by innate 
characteristics of children or models." Beyond this, they raise tlie 

''"See ^Vppendix A for exact correlations. Other researchers have looked 
for sex differences in the test-taking behavior of pre--schoolers with . 
inixed results — Crandall and Rabson, in looking at v^iether children 
chose to return to tasks tliey had conpleted successfully or those at 
which they had failed, found no sex differences among tliree to five 
year olds (althou<^ sex differences were strong and significant among 
children aged six to nine) . Moriarty, on the other hand, found signi- 
ficant Sex differences in the speed at which preschoolers oriented to 
tlie Stanford-Binet testing situation, and in behavioral ^^sponses to 
the TOrje difficult tasks. 

^It is interesting to^note that i^o of the three models demorstrating 
caisistent sex-by-model interactions (Far w4st and Bushell) are one- 
O site models in 1969-70. 



• Part I 
Table Ilia* 



Iiiterac±ion of Sex with >Jodel 
Analysis of Covariance: Adjusted Effects Greater Than 1.0** 

1969-70 rV Data 



PSI Post 



PSI Gain 



Q Post \ 



IQ Gain 



C 



Positive for Boys Positive for Girls 



r 




Weikart (±1.050) 


1 

Bank St. (±1.236-) 
Bushell (±1.375) 


. Far West (+3.533),, 
Tucson (±1.166) 


Bushell (±2.657) 
EDC • (+1.536) 


Far Vlest (±2.809) 
Tacson (+1.542) 
Gordon (+1.622) 


Bushell (+3.414)* • 
Wei-kart (+1.285) 



*A11 inodels included in all analyses. 

**'Ihis n^aii that with the nmn^ffect of sex" taken out, the difference 
between adjusted means is greater than 2.0 points. This antDunts to 
one-fifth of a standard deviation on the PSI and one-sixth of a 
standard deviation on the Stanford-Binet. 



Covariates are age, race, preschool experieiioe, inconne, family sije, 
and, for post- test analyses, prescx>re. 



56. 



suspicion that vvtiere consistent eex -by-model interacti.Dns are demon- 
strated in a variety of sites they may relate not to the "structure" 
continuum whidi has oome^ to dominate discussions of preschooling, but 
to qiiite different characteristics o.f models-. It is striking, for 
exairple, that while the Bushell model seems to favor girls, at least 
in terms .of cognitive outcomes , the other highly-directive model , 
Engelmann-Becker shews no such tendency. These results are quite 
consistent with those reported by Bissell (70), In her reanalysis of 
the Urbana 'aiid New York State preschool achievement data she finds 
effects favoring boys in the one Engelirann-Bg^dker program, but not 

41: ^ 

in another. ' ^ 

Ihe 1969-70 PV data suggest (weakly) that Far Ifest and Tucson 

prograxTB favor IQ gains of boys over those of girls. If the 70-71 

replication supports this hypothesis,' I would speculate that this 

effect mic^t be related to the enpiasis both programs (Far I'fest nore 

than Tucson) place on materials and on learning through physical 

manipulation of objects/^ Montessori programs, vAiich in Bissell 's 
^ J i 

-hhe 70-71 classroom cbservatlon data (the data for 69-70 is not avail- 
able) lends weight to the gufess that Far. Vfest and Tucson enphasize 
learning throu(^ physical cbjects more than most models and that Bushell 
stresses this less than average, This data gives ^^the frequency of parti- 
cular types of behavior observed in PV classroorrs. The frecjtency of 
"aduit infoming child with concrete object" was consistently higher 
for Far Vfest sites than for thq;se of any other naodel (the mean frequen- 
cy was a- shade higher for Wsikart, but all the behavior was- - 
accounted for by one site, Fcfr the other two s^tes the observed fre- 
quency^ was 0,0) ; Far West was the only model where soms of this beha- 
vior was observed in all sites, Bushell' sites had the lowest frequency 
"of thi^ observation variable. 

The pattern for the variable "child-self-leaming with concrete 
cbjects" was similar, with only Far Wsst and Tucscai showing high fre- 
quencies in all sites (the mean freqmncy per site was higher for Bank 
Street, but was attributable to only one site; in the other two sites 
none of this behavior was recorded) • Very little of this behavior was 
O recorded in Bushell sites, 

ERIC , 
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analysis (70) show t±ie strongest tendency to favor'-boys on the Binet, 
also place a strong errphasis on materials and on children learning 
tlirough nian:Lpulation. . , ■ 

Both the 1969 -70 PV data 'and Bissell's suggest that the inter- 
action of sex and program is likely bo be stronger on the Stanford-- 
Binet than on otlier cognitive tests. In the PV analyses all inter- 
action effects on the PSI very small (see Table Ilia). In Bissell' 
analysis regression coefficients for wi thin-mode t-sex effects, are far 
less often significant for the Peabody Picture Vocabulary Test and 
the Illinois Test ^f Psycholinguistic' AbiJity than for- the. Binet. -^Ihe 
enonrous effects reported by Smith are also on the Binet. 

Hypotheses_ 
Strong 

. 1. There will be ho consistent main effect of sex on cognitive 

outcome measures. . , , 

t 

Tliis hypotl^esis is suggested by previous preschool research, 
viewed together. It is supported by the 69-70 PV data. 

2. Within models the effect of sex on cognitive g^ihS:. will differ 
from site to site. 

Ihis hypothesis is suggested by the' findings of preschool 
studies, and supported by the 69-70 PV data. 

Weak—Based on 1969-70 data , - 

3. In Tucson and Far West sil:es IQ differences will favor boys; 

in Bushell sites IQ differences will favor girls. 

Itiis hypothesis is based on the 69-70 data. Hie obseirvation 
data suggests that the tendency of a program to slicw inter- 
action effects favorable to boys may relate to the entasis 
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placed on teaching and leading through the rmnipulation of 
concrete objects'. .Bissell's finding that both Montessori 
programs in her analysis sb/jMed effects favbring boys lends 
strength to this '"interpretation. 
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IV; AGE 



ERLC 



Preschool ^programs are aimed at a populatiqn ranging in age from 
two to six. Most of the experimental efforts based on^ classroom 
experiences (as opposed to home-based efforts like .Gordon *s infant 
program, or one-to-one tutoring progrrims ""^like Francis Palmer's) have 
been directed at children three or older. Althou^ the span of years 
is short, this is a long time de^/elopmeft tally: a child of three is 
very different in behavior, demands, and capacities from a child of 
five and a half. It seems possible that some models of early education 
would nake their greatest iirpact on children near the bottorr. of this 
age range, v^ile others would be most effective with thv^ older 
diildren. 

Previous Itesearch " ^ 

Canparative preschool evaluations have not in general been able to 
explore the possibility of an age-b^'-program interaction because they 
have limited the age range of entering children at the start. Having 
reduced the span of this variable to less than one year, researchers 
prci'ably assume a priori that it will account for little of the 
variance < 

The assunption that age at entry will be unoorrelated with cogni- 
tive outcomes is supported by Hodges, Spicker, and McCandless (67) , 
who, in their oorrparison of two progr airs for Appalachian l"ive-year-old^^ 
fjj^d no significant relation between age and gains. llOA^vcr, their 
ai^alysis pools groups, examining togetlior children in tlie experimental 
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program aiid those in public kindergairten , so it does not eliminate 
the possibility of an interaction. 

Palirer (70), by contrast, in a concept- trainincf project with two- 
and three-year^ld Black boys, does find a relation between age and 
cognitive gains, and the suggestiOT of an agsyby-program interaction • 

Two training procedures were used in one-to-one tutorial sessions; 

/ 

one involved sequenced pre-planned sessions w/th considerable adult 

initiation; the otlier adopted, a "discovery" y^proach, with adults 

t / 

responding to children's 'initi^ations , rather than the otlier way. One 
year after treatment, results on the principle evaluative measure, the 
Concepts Familiarity Index, shew that for the groi:o5 trained at two 
years of age' those taught by the discovery rfEtj;KSd are significantly 
above the I'raining sairple, while for diildren tauc^it -at age three tlie 
I'raiping group is significantly above the discovery group. On the IQ 
measure differences tetween teaching methods are insignifican"c, but 
age of, training does appecir to make a difference: threes outperfcjirm 
twos immediately a^ter training and one year later. 

Van de Riet*s (72) evaluation of Sprigle's "Learning- to-Leam" 
program also shws inportant effects of age on cognitive gains: the 
mean first-year IQ gains for children entering the experimental pro- 
gr^ at age four is twice tl^.at of rhildren entering at age five (9.1 
^xjints vs. 19. 7. points ) , even tliough the initial IQ of the two groips 
Is the same. 

Ihese* findings do not provide specific hypotheses ooncerTLing 
by-model interactions, but they do suggest that, within particular 
^ programs, age may be strongly related to gains. 
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1969-70 Data 

Vtien the FV sanple is divid^ at^the median age of entry (59 montlis 
in October) .into older and youngfer groups, a few rnDdels include only a 
few cliildren in one group or the other. This is because in particular 
sites tlie age range is narrw — usually about one year. Age, thus de- 
. fined, is therefore confounded with Bite and sponsor, so an analysis 
of variance model is an inefficient way of looking for main effects 
and interactions based on age. 

"^ince age is, in any case, a continuous variable, regression 
. c has been used instead of ANOVA. For each model age is regressed 

against post- test score (gains are not used on these analyses) on botii 
tlie' PSI and the Stanford-Binet, controlling for prescore, se:^v"P5^evious' 
/ prdsdiool i^xjxjrience , race, raoe-by-sex interaction, motlier's education, 
incore, and family size. T!ie magnitude and direction of tlio regrc:::^ion 
coefficients so obtained gives a measure of the effect of age on tlie 
cognitive post- test score. Since the unit of age is mrnths, a co- 
efficient of ,5 means tliat a diild of five has an advantage amounting 
to 6.0 points on the post-test over a similar child vdio is a year 
you'-ger. Similarly, a coefficient of -1.0 would nean thatffor the 
model in question four-year-olds outperformed ccnparable five-year- 
olds by an average of 12.0 points. 

'Iho partial confounding of age span and model raises some (Jjuostion 
about tiie validity of this approach. Specifically, if tlie effect of 
age on post-test -is not linear, then tlie regression coefficients for 
programs with mainly older or mainly youhger children will 'Shew bias. 
To check this possibility, age coefficients were, calculated separaitely 
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for older and younger children for those models with a sufficient num- 
ber of eaGh."*" Hiese analyses revealed no significant differences 
bctvveen age coefficients for older and younger children within modelS. 
ihe effect of age on post- test is therefore assumed, tj:) te linear 
v;ithin models. 

« 

Preliminary aj.alysis of PSI data for the entire sairple (1408 , ^ 
diildren) revealed an ^interaction betv.^een age and previous pre3chrol^ 
experience: the age coefficients for children with and without pie- 
schooling were significantly different from one another. For child-- 
rcn vjitl^i preschool oqxsrienoe, B - .0097 (n = 472); for those without 
suclt cxfjericLnce , B = .205 (n « 936) . ' The first value is insignificant 
wliilc tJic second is significant abovt? the .006 level. For tl^is reason 
separate" coef ficijoniis were obtained^ for diildren witii and without 
prosdicx)l experieno^ both for the PSI and for the Stanford-Binet. For 
the PSI, coefficients were calculated fi6i the v^iole sanple and then- 
separately, wiriere possible, for children Ai^der 60 months. Ihis was 
done because the distribution "b^ post- test scores indicated the 
possibility of a slight ceiling effect for older childreji witl*) prior 
preschool ej^rience. Mthougti this effect was 'not strong, it iniuiit 
have been expected* to bias downward the coefficient for programs 
wliidi mainly served this groip. 

"4his analysis was carried out For^ the IQ only, Ttie [)rcx:'edurc for 
the PSI is described bnla^. 

2 

Separate regression equations were calculated for each model, 
usiiig as indepehdj^t variables age, pre-test score, sex, race, race- 
byAsex interactidn, preschooling , mother's education, family size, 
arid income. 
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( 

For diildren without presdiool e>perianoe, the pattern of cx>^ 

efficients is not altered by including older children in the analysis. 

Either way, the regression coefficients c±itained for Tucson, Bank 

Street, Bushell and Gordon programs exceed^ those cfctained for the • 

whole sanplG (.205) , while those obtcoined for Far West, Weikart and 

1 

EDC are less than .205. Bet^:een-model differences are not signifi- 

cant^ for young children without prior preschooling; when oJ.der 

children are included, Tucson is significantly different from (greater 

than) all groips except Bushell. * 

For children with previous preschool exji^erience the pattern is 

reversed. For the younger sanple the coefficient for age js" less- 

tj\n .0097 for Tucson, Bank Street, and Bushell programs ar?d"greater 

tlAn .0097 for Weikart, -Gordon and EDC.^' When older children ^are ~ 
/ ' ^ 

(included more programs show negative coefficients, suggesting a 
^ ' - 'A ' ' ./^ J 

ce*iling on the post- test for older childreh with previous jireschooling 

_ ^ ^ ^ — _ 

^Becker-Engeirrann ha^' too few young chi.ldren to be included in the 
"^ung only" analysis; in the full-sanple analysis it falls with 
Far West, EDC, and Vfeikart.^ 

^IWo-'tailed T-tests^were used to evaluate the significarice of differ- 
ences Ijetween 3-weights. I < 
Since separate equations T = ^1 ~ ^2 J ' 

were used for each model y 1 '-^ 

tills test is not strictly V^^i ^^2^ 

valid statistically. It ' 
is a heuristic indicatjing the mc^gnitude of the effect. 

3 

Becker-EngeliiBnn and Far West do not have enough young diildren 
with preschool, e^^rlanoe to be included. 

• J •• - 

^The coef ficiejit for age is observed to bey^reater in lUcson than in 
other models. \ A two- tailed test shows it /to be significantly greater. 
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1 

Wii±iin the younger sanple the age' cxDefficienta for W^ikart and EDC 
programs are significantly different from (greater tlian) those for 
Bank Street, Tucson and Bushell. The Gordon program is not significant- 
ly different from any of the others. *Jh^ the ^.ole sairple is con- 
sidered* the only significant difference is bettveen Tucson and other 
p.rograjTB . ^ 

Hiese coefficients ref*esent-in scire cases a fairly substantial 
effect.. Uius, in the Tucson program an age .increase of one year for 
children without earlier preschooling is worth more than ten points 
on the PSI post- test, with- other variables ccntrolled. For the 
Decker-Engebnann progr'am the difference is in the opposite direction, 
with younger chiMren scoring soire^.\tiat higher than older ones on the 
post-test, after- tli^ effect of the otheX, variables is takqp into * 
acfcrovint. ) \ 

The data on IQ for children without preschool' e:xperienoe shows a ^ 
pattern ver;^' similar ho the PSI: for Far West-, B^nk Street, Engelrflarin- 
Becker; Vfeikart aqd EDC thg^ relationship between age and adjusted 
post- test is negative. For Tucson, Bushell cind Gordon it is*positive- 

0 

/r-tests for differences among the coefficients shew the ""coefficient - 

for l\x:son to be significantly less than that for Bljsheil and greater 
>■ ' 

tJian those for oi;her programs. The differences between coefficients 
for Gordon, Weikart, Far West, EDC, Becker-Engeln-ann and Bank Street 
are insignificant. 

1 * ' 

Results for the Bushell program should be cautiously interpreted 

since the n is very smll. > 
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Part I 
Table iVb 



PSI Post-Itest 
Regression Coeffipients for Age (in months) for 
"Young"* Children with Preschool E>^rience** 
' " 1969^ PV Data 



J - 






> • 






Tucson 


Bushell ■ 


Gordon 


Bank St. 


Weikart 


Ebc 


-l.jl3 


-.349 


.510^^- 

( 


-2.36 

« 


1.28 


2.06 



*Under 59 months in OctdSer, 

**Other variables. in equations include pre-test soorc, sex, race, race- 
by-sex interaction, previous preschool experience, -^iTOther's education 
family size, and income. 
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IQ data for d^ildren with previous preschOoling are available for 
only a few prograirs (Engelnann-Becker^ WbiJcart, Gordon and EDC) . Co- 
efficients for all these prograins are insignificant; they are negetix^ 
for three of ^ie four» 

These data on the relationship between age and post- test or two 
cognitive tests are very far from providing a clear picture. Hcwever, 
■ sare rather murky patterns do enierge. First, the relationship between 
age and _gains appears to be stronger for children witl^iout previo^js 
preschooling than for those with it. Ccef ficienrs are larger, cind for 
the sairple as a wiiole (sponsored and unsponsored 'diildren) the ago 
coefficient for children without prior preschooling is "significant 
while that for children with 'previous pitischool is not. 

Second, for children without previous preschooling, oertai^n ^ 
prograirs seem to promote cx>gniti\'e growth nore effectively for older 
diildren while other prograirs achieve their best results witJi younger 
diildron. 'fhese ac^ effects are consistent for PST and IQ: younger 
^^"diilllnm gain npre than older-'- in Far West, Deckcr-E^goiiTann , KDC 

and V^ikari: programs; older children gain more in Bushell, Tucson and 
Gordon programs. For Bank Street, results for the two tests are 
inconsistent, with age sho/zing a significant positve effect on PSI 
score and an insignificant negative effect on IQ. • r 

Hiird, the relationship between age and cognitive gains within- 
a program does not e^^pear to be related to the degree to which tlie - 



In Uu' c:a3e of thtS PSI t}\is means that yoiincjtjr diiMrer^ ^rnin itKM^r 
111. in nx|x»(''.t3(l witJj r\i].rtt.io;i to oiclnr {'JilMrtM^, ftiiu'<' tlu^ (^fl-x*^'!' !m 
.2iy>, ?K)l /ort). 'JIiIm Ah l^x:nu?.u^ r:!l , whUh In no! .ntnnttni /.pjI 
ip/ fKp, mIktws ixjsiLivc* tM'foct for atji.^. ^ 

O 
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program could be considered "directive." Neither does ^>~^ , 

it relate to other obvious attributes of the. models. 

HypotPieses * 

Vfeak —Based on 1969-70 PV Data 

1. Hie relationship between age and adjusted post-soore on PSI 
and IQ tests will be stronger and more significant for 
children without previous preschool experience than for 
diildren witn it. 

2. For children without previous preschooling, age will oe 
pk:)sitively related to IQ and PSI post-test in Tucson and 
Bushell sites. In other rnodels the relationship between 
age and post-test score will be negative or very weakly 
positive. 
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V. SOCIOBGONOWIC STATUS 



Much of t±ie work on experimental preschool approaches vAiidi was 
done during the sixties was based either inplicitly or explicitly on 
the idea that a program which was satisfactory for middle-inoofre 
diildren was not necessarily optirnum for low-income children. The 
. traditional nursery school has been the presdiool experience of thie 
'middle class for over a generation; .it was hoped that some otlier 
approaches might yield irore iirpressive results with the disadvantaged. 
In large part, of co^arse, the new approaches gre<^; out of new objec- 
tives for preschoolirig — cognitive' prep^ation for school , ratlier than 
socio-emotional development; however, the idea that differegnit strate- 
gies are app:fopriate to different populations was often also iirplicit* 
It seems therefore inpojrtant 'to ask, as a good many researchers" 

have done before, whether, within the F\/ sample of iiead Start models,^ 

sone approaches are most successful with the most di^sadvantaged and 
otliers with the least disadvantaged. Clearly, the PV sanple of diild-- 
ren is not optimum fcr pursuing th^s question, since all children 
who are eligible for Head -Start come from relatively poor families. 
Hc^vever, it is 'still of interest t© know vrfiether within the Head 
Start target population SES is differently related to gains in differ- 
ent programs. * ^ 

Previous research ' ^ 

A nurrber of resaarchers have ej^^lored the possibility of *an inter- 
action between S'S and programs for presdiool diildren. Most recently 
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Bissell (70) has reviewed previous studies and re-analyzed the data 
collected by Karnes ^ DiLorenzo and \^ikart in Urbana, New York State 
and Ypsilcoiti. Her results, and those of other researchers, suggest 
that cogniti\7e gains are differently ralated to SES in different 
prograiTB, Specifically, Bissell finds Aat in less-structured rrodels 
(traditional, Montessori, and Weikart) , gains are positively related 
to SES, while for highly-structured prcgrarhe^ (Bereiter-Engelmanri. 
and Karnes Arrelioration Program) , the relationship is either more 
weakly positive or negative. Ihese 'findings are conpatible with the 
earlier findinos of Sprigle and Van de Riet and of most others who 

have explored the SES-by-model interaction, 

IP 

The data of Kraft, Fuschillo and Herzog (68) extend thir finding 
in an interesting way, raising the possibility^ of a second-order 
interaction between SES, program., and previous preschooling, - As 
note^d^'in the section on previous pro^school experience, this stucfy 
of a -vtraditional nursery school finds that while SES is related 
positively to gains for the first yea:: of this program, tl\e relation- 
ship is negative for the second year, 

19.69-70 PV Data • ' 

Using a measure whidi weights eqxially inoome, mother's education 

f 

and family size, childi"en are divided into two SES categories, 'hi^*' 
and "low"."'' Four analyses of covariance (IQ and PSI gains and 

— 4 



•'"Income, nother's education, and family size are all standardized; each 
variable is given a mean of 0.0 and a S.D. of ±1.0. A diild's "SES 
score" is the sum of his standar}dized scores on these three variables. 
If his SES score is above the mean he is assigned to the "hi^i-** category ; 
if it is belcw the mean he is assigned to the "lew" gro.i.p. For thv\ 
315 children incl\x3ed in the IQ analyses sanple means are as follow : 
4j income, $3401; mother's education, ei^tkfcgrade; family size, 5.5, 
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post-test) have been performed for PV children in ^fepdnsored classr ; 
rooHB vs^o had taken both IQ and PSl tests. Children are. stratified 
by SES category and by model; the main effect of SES and the SES-by- , 
model interaction effect have teen oonputed, ^ \ ' * 

Main effects of SES' are significarit , thou^ small, /for both IQ 
analyses, ifawring hi^ SES children (tlie difference berween adjusted 
nBans being 2.74 for IQ post-tes€^d 2.662 for IQ gain) / Main 
effects for the PSI are in. the opposite direction and iJDsignificant, 

Interaction effects are small and insignif icarit overall for all 
analyses. The pai:terns of the adjusted effects on these analyses, 
such as they are} are r-imarkably consistent with one another (see 
Table *\^a). In general, the four' analyses show, weak effects , favoring 
lew SES children in Bank Street, Far West, Tucson and-EDC, ar^d favor- 
ing higti SES children in Weikart^, Bushell, and Engelmann-Becker, 
These results are inconsistent with Bissell's*'" in ^1 respects save 
one: in her analysis and in the PV data, WeikaLrt's program shcvvs 
an effect favoring hi^ SEJ children, 

It at first seemed possible that these puzzling results mi^t be 
accounted for by ^e two-way interaction involving' previous pre- 
schooling which the data of Kraft, Fuschillo and Herzt)g suggested.* 
Hovever, a second set of analyses^ using only diildr&i without previous 
preschooling reveals a similar pattefn: overall interaction effects' 

•^Ihe PV sanple of rrodiels is somewhat different from Bissell's: " . 

sjgcifically , models in the jniddle range of ''directiveness" are somevs^iat 
more. heavily represented,. 
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Part I 
Table Va* 



Interaction of SES Category with Model 
Analysis of Covariance: 
Mjusted Interaction Effects Greater Ihan 1.0** 
1969-70 PV Data 





Positive for High SES 


Positive 


forfiow SES 


PSI Post 


Weikart (±1,088) 


Far West 


(±1.999) 


PSI Gain 




Bank St, 


(±1.061) 


IQ Post 


Weikart (±2.999) 


Far West 
Bank St, 


(±1.413) 
(±1.821) 


IQ Gain 


Vfeikart (±1,575) 


Far West 
Bank St, 


(±1.026) 
(±1.179) , 



*A11 analyses include all models. 

^^Ihis means that with the main effect of SES category taken out the 
difference between adjusted ireans is greater than 2.0 points. Ihis 
amounts to one-fifth of a standard deviation on the PSI and one-sixth 
of a standard deviation on the Stanford-Binet. 

Covariates are age, sex, rao^ , preschool experience, and, for post- 
test analyses , pre-test score. See page 32 for e:$)lanation of 
adjusted effects. 
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are insignificant, but the Weikai:i:> progranB shcy a fairly strong 
ef/ect favoring high SES children, vtiile the Bank Street program 
shaved consister*t fleets favoring lotv SES children. 

Ihese results raise rather than settles questicns. Without Uie 
PV data, there would have been every reason .for a hypot^iesis that 
more directive prograrns favor la J SES children and less directive 
models favor high SES children. The 1969-70 analyses favor an oppo- 
site hypothesis. I cannot suggest any' totally satisfactory resolu- 
tion of this contradiction, but two points seera pe-rtinent. First, 
because the ?V sarrple is a n^imal one, our indices of SES inay be 
inadequate: a given income, educational level, and family size may 
add up to. quite different SES levels xK l^ssissippi and EXiluth; by 
pooling children in dii-f ferent regions are probably diluting the 
strength of our SES measure. Unfortunately we would have to knov 
more than we do about eccnomic and social conditions in these Head 
Start oonnujnities in or'der to make appropriate regional adjustments. 

Second, we knew that progranB do not look exactly the same in 
Planned Variation classrooTE as they do in sponsors* ej^^eriinsntal ' 
preschools (Ldvas and Vfohlleb, 72) . It may be that the interactions 
we observe (su^ as they are) result not from intrinsic properties of 
the P"-^ mcjdels, but from a eortplcix int6Q;action inwlving the demands 
of- the model, its "ease of inplementation , and the expectations of 
teachers, administrators, and parents in Head Start. Thus, teachers 
attempting to implene .it .models vfcch enphasize- cognitive ,devei.opment' 
• may inadvertently 'oono^trate on ttife most recepti ve ciiiidren—tliose ' 
^ of high SES. Teachers inplementing models which are closer to their 

ERIC . . 
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own experience and irake fewer demands for cognitive gains may feel 

freer to concentrate on the children v^q seem to need help tJie rrost. 

Head Start itself, as an insti^tion, may frame teacher responses in 

distinctive Ways. 

The sensible reaction to these puzzles is to taS^ a hard look 

at the 1970-71 data. In the meantime, the first year's da t^ raise 

the suspicion that interactions between SES and model vdthin the insti- 

■Ik 

tutional and local framework of Head Start ^may be .quite different 
from what one gets in e>perimental preschoolsV.,^.^j:f the 1970-71 data 
confirm the pa.ttem of the 1969-70 data, then we will have to e>q3lore 
the reasons fof this at greater length. 

Hypotheses 
. Stropg 

1, Within-model effects will favor high SES children in tlie. 

Weikart nbdel. ' \ 

This hypothesis is suggested by Bis^ell's anal^^lis dnd / 
supported by- the 1969-70 PV data. ■ ^- ' 

Mfeak— Based on 1969-70 P V Data 

2, The overall interaction between* SES and m:>^el will be insigni- 
ficant both for rhe PSI and for the Stanford-Bin^t. 

3, Within-model interaction effects on' the Stanford-Biiiet will 
favor low SES children in the Bank Street and F,ar;^st pfograms. 
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VI. ETiiNiciri ■■' ' • ^ 

Only two ethnic-ciiltural groups are represented in Sufficient 
niJtnbers in the PV sairple to be inciud^zd in an etnnicity -by -model ■< 
analysis. India-i and Spanish-^^aking groips are included in too 
few sites, and in insufificient nunbers, to roaifie a cross-program con>- 
parison possible. For this reason, the prese-nt analysis is limited 
to Black and wtiite ciiildren, and to those few models which) incl\xie 
enough of both to make wi h-in-model conparisons possible. 

Previous Research 

. f , ^ 

TWO o^ che studies reviewed by Bissell (70) — Dilorenzo (69) -and 

Teska (69) — examine the relative performanoe of Black and white child- 
ren in a range of programs. Like Bissell, these "^searchers report 
greater Stan ford-Bine t gains for whites than, for Blacks ^ross pro- 
grams . However , neither DiLorenzo nor Te^ska ccfntrol for SEI , so these 
findings , are predi' - ibl^ Tgains are usually correlated with SES; 
Blacks are generally of lower SES than whites )^ . Bissell does control 
for SES. Using the same SES scale for both races sh^e finds whites , 
gaining more ^han Blacks o¥ conparable SES. Wien the SES scores of 
Blacks are adjusted dcwiward (on the assurrption that the actual , 
status of a Black family ancJ a white family with identical SES ratings 
are different) Bissell finds no clear pattern in the achievement of • 
Black and white children. Eridkson (69) , in his corparison of tra- 
di.tiqnal and Bereiter-Engelnmn approaches, finds no evidence for 
a race-by-program^^interaction. 
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1969-70 PV Data * ' > ' 

Qnly^/ive of the eight models7=l\icson , Engelirann-Becker , Busbiell, 

' ■ - . V 

Gordai and EDC — are included in the PSI analyses: the others have \ 
very few children from one of tl-ie two ethnic groips. On the IC 
analyses the r^Mnter o? incdeJjs is fiirther reduoed by elimination o 
Gordon and . Engelmartn-Becker (models are excl^jded froan an analysis when. ^ 
one includes fewer than se\^n children) . ^ \r' ' 

y 

Tile ntiin effect of race is sigraficant in only one of the four 
' analyses'of cov£uianoe — the PSI ^pst-test, .Ihis analysis shows, a 
^small effect favoring white children — a difference cf 2.2 points on 
the oovaried post- test score. ' In the two gains analyses, effects are 
insignificant, but favor Black duldren. On both tests, Black child- ' 
ren pre~test lower and gain sore^at more than v*iite childinen; 

' Interaction effects are significant on all four analyses (see' 
T-^bl : ^Vla) . Ihe strangest consistent interaction effects are those - 
f avoring Black' children in .the Busl^^^ll modffl and white children in 
Tucson and Engelnann-Becker. knew of ^ logical way in v^ch- to 
interpret these 'ults: thry lend weight to the suggestion that ^" 

v. 

ccnsistent, interpretable race- by'^riodel interactions are unlikely to 
^ emerge. Table VLa suggests that the dimsnsion of directiveness is 
irrelevant to any interactions observed. If the offec^' suggested in 
these analyses are replicated in the 1970-71 data^ it would be in 
order to speculate on the reasons for the narked difference ibeti^en 
Bushell and Engelitann-Bedcer. 



/ 



^Ihe pattern observed for EDC reflects site effects: the mainly Black 
EDC site in Washington, D.C. shows larger PSI gains than the mainly 
\^ite site iSi Jd'Jiston County; the Johnston County site, cn the other 
hand, shows greater IQ .gains. A 
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Part I 
.Table VTa"^' 



Interaction of Ethnicity with Model 
Analysis of Covariance: 
Interaction Effects Greater Than 1,0 Points** 
1969-70 PV Data 



PSI Post 



PSI Gain 



IQ Post 
*^ IQ Gain 



Effects Favoring 
Blade Children 



Ef^cts Fa^/oring 
Vvhite Oiildren 



Bushell (±1.081) ■ 
Gordon (+3.309) 

» 


Tucson ' (+3.1G8; 
Engelmann- 
Becker (+2.109) 


' Bushfell (+2.570) 
Eiy , (+1.103) 


; Tucson (+1.920) 
/ Engelrtann- - 

Becker ' (+.\750) 


Bushell (±3.005) • 


■ 1 1- 

EDC ^ (12.864) 


Bushell (y,0iOI^ 
1 


EDC (±3.695) 



*PSI analyses include Tucson, Engelinann-Becker, Bushell,, Gordon, 
and EDC. They exclude Far West, Bank Street, 'Shd Wsikart, IQ 
ancJ.y^s incluSe only. Tucson, Bushell, and EDC. 

**Covari^tes are age, sex, preschool experience, incdne, family sizi^, 
and, for post-test analyses, pre-scqre. For an explanation of 
adjustedl effects, see page 32. 
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I-Iypo theses 

^ak— Based on 1969-70 Data- 

"3 

1. Within-program interaction effects will favor white children 
in Engelmann-Becker and Tucson prograne and Black diildren 
in -jushell pix)grams. 



VII, RESPOCE STYLE 

Response style refers to the wdy in vs^iidi an individual behaves 

when confronted, with an intellectual deinand — to the inanner in whid] 

he characteriBtically attacks or avoids cognitive problems. Conoep- 

>- 

tually, it is independent of the correctness of a child's answers to 

partici}J.ar questions, althou^ it is of course possible — depending 

.on hew response style is defined — that bridit xiiildren will adopt 

. (I 

particular styles more often than dull children. It seerre reason- 
able to suppose that certain educational approaches and assunpticns 
would prove effective with children who characteristically deal in 
a particular way with cognitive deinands, v/nile. others night work 
.better for children v^o errplqy a different stylte. 

Ihe Planned Variations data provj.des one interesting clue to 
a child's response st^de: the Heirtzig-Birch scoring of the Stanford- 
Binet. Instead of . siirply inaiking chi ldren's responses to each item 
right or wrong, testers \jsed one of the ei^t Hertzig-Birch cate- 
gories to classify his answer. The following selection frt the 
Binet testeirs inai;iual describes the oodes . The first twc categories 
describe correct Answers, x^ie last six are ^jsed for irii:x)rrect ones. 



L 1 ^ 

^ In ti IS stufy "response style" is defined by the Hertzig-Birch 
scoring of tlie Stanford-Binet. The response style, variables derived 
from this instrument do not, in f^ct, oorrelate strongly with initial 
IQ. See i^^^pendix A. For, analysis of respcaise style data on two 
dk.'fferent pcpulations see Hertzig, M.E,, Birch, G. , Mrtmas, A., and 
Mindez, O.A. , "Class and Ethnic Differenoes in the I^ponsiveness of 
Preschool Children to Cognitive Denands", Monographs of the Society 
for I^search in Child ftevelopment , 33 (1) , 1968. 



Coding Categories 

1. 1>D limitation ." TJie child's response to a worf<: item answers t^e 
itnm but provides no further elaboration. For exanple, a child 

■ "iTiight correctly fold his paper to mtch t±iat of the ex~JTdner 
anu then sit quietly or qi^/e the response , Vood" , to the quss- 
ti.on, "What is a house rra(^ of?" 

2 . Spox^taneous Extension . Ihe diild worfc response is acconpanied 
by an unsolicited elaboration related to the item. For exairpie, 
after she finished stringing beads, a girl ties the c-inds of the 
strijig together and tries to slip it over her head, or she mic^it 
say, "Yours is smaller than mine", in coirparLng her to^er of 

four blocks with tl-ie examiner's model coni^isting of three blocks, ' 

3, Incorrplete , l!ie ciiild fails, to corrplete the task (either a 
verbal or non-verbal task) and does nothing else (categories 
4,5,6,7 belc^s^) . 

4, legation . Direct refusal to work, such as ''No, I won't", "1 

' dcDTi't want to", or "I don't like to do it" or shakes her head or 
turns a^ay to indicate refusal. 



5. Substitution . Ihe child offers an irrelevant verbalization or- 
engages in ir^levant physical activity Instead of responding to 
the task requested. For ex.^rple, a substitute verbalization ^often 
takes the form of a request for an al.temative activity, such as: 
"I want to play with tlie toysnow", "I want to go to momrry", or 

"I want a drink". ^kxl~v^1i^Csubsti nay be of the follow- 

^ ing type: Khen asked tc/b\Ald a block bridge, the ciiild gets up,, 
goes to the toy shelves anc begins to play with a truck. When 
asked to describe the p.ctires, the child gets up and runs cut 
of the room. \^ ■ ' ' 

6. Conpetence , The child states some litrdtation of ability to per- 
form the assigned task. Such responses include the following: 

"I don't know how", "I'm tdo little to do it". It is possible, 
thoucii nlikely, thiat the child can convey his feeling oT lack of 
oonpetenorj by' use of gestures and animation, 

7. A:d. 'The child maker a direct request for help from the examiner. 
ihTs would include such comments as, "Show ne how to do it", or 

. "Tall me^^^at the answer is". ' It is* unlikely that a request fcr 
aid wiir^ rrade non-^verbally . ^ • 
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Passive. This is a l>)o Responseocategory . The child may just 

sit still when, for exanple, sticks are presented, or look straight" 

ahead and say nothing v/hen askod to tell 'a story about pictures. 




'rhcsc categories were originally worked out in a study coirparincj 

tlie cocriiti\'e st^'les of laver class Puc^rto Rican and middle class 

wiiitc diixdron in ^vcw York City (liortzig et al , , 1968). For tliis 

stud\"''t.ie entire stream of each child's behavior was' described; the 

categories wore de^ '^ed eirpirically from the data.. 

' Viic procedure ^jscd by the Planned Variations study\dif fers in 

two ways from that of +-he Hertzig study. First, the PV tester codes 

only the last response to eadi item. This is necessary for rceisons 

of rcliability, since testing and coding are done by the same person 

(in the Hertzig study" one person aciTiinistered the test while anotlier 

recorded tlie child's behavior) . . We do npt knw how much in f oration 

is lost in tlus way."'" Second, tlie categories ueeci .jy PV describe 

incorrect work responses less coirpletely than those of the original 

studb^'. ' Categories 1 and 2, delimitation extension, apply only 

to correct answers; there is no equivalent distinction for an incorrect 

response. Since testers cabegorizeTjnost incorrecttfssponses as 

"inconplete" (code 3) , infonration is certainly lost. 

Despite these limitations the Hertzig-Birch scoring may provide 

d 

interesting infonration about a'diild's way of dealing witli a set 
of cognitive problems which range from the very easy to tlie very 
difficult. It seems intuitively likely that a child who often 
3sponds to difficult items by substitu'dng a different activity may 

■hhe loss could be considerable. Thus, for exanple, if a child works 
for eight minutes on the block bridge' and then looks up at the fester, 
saying, "I can't do it", his response is described only by code 6. 
Ihe researcher has no way of knowing whetlier the child attenpted the 
probJ.v^n at all. 
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beiiavT^ clif forontly in tliG classroom than a diild who becont3s mutx^ oi'id 
tn".resrx:)nsive wlien laced with p.rcblems he cannot sol\o. &.^n bhougil 
tiie Ilcrtziy-Bird) coding does not pro\ddG a total pict^are of tine 
diild's bd\a\dor, it^iray give a valuable clie tx) his ,style, a clue 
which would help us to predict the t^pe of pir>grain in whidi he will 
learn best.* 

Previous tesearch 

Unfortunately, tliere is almost no research v^idi aids in pre- • 
dieting the natuiiB or strength of an in*JractJ.on betveen "style" — 
as indirated by tlie Hertzig-Birch data — and nodel. Predicting, or 
even understanding, such an interaction is peculiarly conplex, I rhink, 
because we knw so little about wfiat tht^ benaviors indicate — or hew 
they mi(^t interact with diaractjeristics of models. 

Ihe behavior so coded may provide two kinds of information 
about a diild. The first conoems his state of mi.nd at the time of 
testing; a particular resT>Dnse, say passivity, may be an indication 
of an>dety, boredom, feai" of' failure, or ^jonfueion. If we had ^olid 
evidence that such a response was characteristicaliy associated with 
one of tliese (for exanple, test anxiety) we mi<^t have some basis for 
predic'iiiq an interactJ.on between frequency of passive responses and 
gains in particular programs . 

There however, a second aspect -to the situation. A particu- 
lar behavior is irrportant not only as a sign of the child's Teelimg 
about testing. It is inportant in itself. Teachers prciably respond 
differently to children wi:o meet their dennnds with irrelevant 
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v'erbalizations , whatjever the reason for this behavior, Their response 
and tlie diild's 5i±)sequent learning and behavior — may vary from model 
tc '^xxtel, (It vVili certainly vary from teacher to teadier,} , 
Tiiere is little research to aid 'cs either in deciding vjhat 
particular types of responses might "nBan" — what state of mind on the^ 
part of the child they usually indicate — or hew aspects of differ^^t 
iTodels mi<^it lead adults to respond differently to the behaviors 
thenselves. A study of the behavior of primary'' school children during 
RDrschach testing (Sarason, 58) suggests' that +^,vo of the Birch beha- - 
viors, Negation (code 4) and Substitution (oode 5) might be related to 
test-anxiety,''' Hcvvever, the 1969-70 data indicates that the variables 
derived frsm these two codes do not interact strongly with model 
characteristics. For "passive" and "conpetenoe" responses . wtiicii rjo 
^DiiG^^' some interaction with model, we have little beyond intuition to 
illuminate the meaning of the ..>ehavior. 



In this study, sixty- four children v^o had previously been rated 
on test-anxiety according to their answers to. a qrestionnaire 
were given Rorscl-.ach -tests. Descriptions of their best-taking ueha- 
vio:^ were submitted. to clinicians, v^o were asked tq classify each 

"rfiild as high or low on test-anxiety (of t±ie 64 children, 32 were in. 
the top ,qua^le of test anxiety while the other 34 were in the 
bottom quartile) . The clinicians were asked to indi,cate v^ich 
behaviors they had used to classify children, and the frequencies 
of these behaviors airong hi^ and low anxiety children were then 
^tabulated. IWo v^ich mi(^t relate to our categories and were 
positively related to test-anxiety were "rejection of one or more ' 
cards" (p « .05) and ''not responding to the stiriulus area of the 
card" (p = .025). Ik^Tever, one. would clearly have to be Lent.ativi? 

. in iTBking a parallel between Rorschach and Binet testing. 
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1969-70 Data '■• 

Lacking any persuasive theoretical grounds for predicting parti- 
cular interactions befcveen response st^'lo. and F7 nrxiels/it seeire ^ 
essential to take an erq;/rical approach to 'che data. The frequency 
distriiutions (Table Vila) neveal thr.t botl-i in tlie £all and in the 
spring over 85% of al.1 responses are coded 1 ,( delimitation) or 3 
(inconplete) . Viien answering oorrectly, children do not \jsually go 
beyond the requirements of the task; if unable to answer copcectly 
they still generally irate a nelevant "work" response. Table Vila 
gives rrean and roadian frequencies of each response (per child) for 
fall and spring ^-esting^, plus the percentage of childrej^ making no 
response that cat;egory. 

The- response stylq analyses are ai^ -d at discovering how specific 

de\7iations from tlrie usual response pattern (a hit^ incidenoe, for 

(?xanplc, of extensions or p^issive rcspcj^nses) relate to ccxjnilii^/r^ 

<:]ains in particular irxDdf^ls, Ihe i^crtzig-^Birctr c!5odes aro of j'nt ^rost 

for wi-iat they reveal -about initial differenoes between children — 

not differenoes wtiidn result frocn participation in* pcurti cular pro- 

■- -\ . * 

> p 

grams. For this reaso:. oflly rt^ponses on the IQ pre- test are used; 
Since the test was given about three weeJcs afi:er the" cpening of sdiopl 
it is no"^ inoonceivable th^ children's manner of response might ^ 
already have -been affected by differeiit model eirfiiases. If this 
were true It would cortplicate interpretation of any interactions 
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pbservfed. In fact, hc^\/er, it doeo not appfear to pose a serious 

problem. There seerns little object in exaimjiing categories \>rfTiich ' 

, shewed jmnimal variability', ?o oodes 7 (request for aid) and 4{ Orefu- 

satl) are eliminated, j3rily 10% of the children have any responses at 

all whichi afe coded .in those two categories 'at pietist. The renaining 
. , ' ^ " - . . . . • ■ O 

four categories* — extension, substitution, COTpetehoe, .and" passivity — 
. ' ' • . 4' * ^ . ■ 

are not hic^.ly correlated either with one another, .or \\?ith background 
variables (See Appendix A for intjercoifrelations among the'fow varia- 



bles and t3ieir correlations with age , preschool -experience 



, 10., s^, 

race and SES) . Jt therefor^ seems logical to examine each one se^^r- 
ately. ^Children, in ^1 models ^^o have valid scores on .tpe Star.ford- 
Bin^tT pre- 'and post-tfets are "characterized as "hi^" pr "^ow" on' 
each of the four behaviors depending on how many resjSbarrses in *each 
category they made on 'the initial IQ test, - FoK^each variable, the 
-pretest sarrple median is taken as the cyt-off between hi^ and low 
(for extensions and passive responses low =0,0, for substitutions 

: — '\ ' — ' . 

To check this possibility I have looked at the nunter of children in 
each model s.coring above and belo^r the sarrple rredian for '^oonpetenoe" 
and "passive" responses^ (tl^se are the Hertzig-Birch variables v^ich 
shew sane sign of interact^g vith •rro^l-jjsee text) , A *x^ test* 
shoA^s no significant differences hietween models for "oonpetenoe" 
responses — indicating that program' en^iiases do no€ significantly 
. affect children's tendency to use this typp of response by the time 
of. pretest, Betweerv- model differerices 'are significant (p < ,05) for 
passive responsejs, . Hc^vever/'the sigrdficanoe of these differences 
is attributable to the.hi^ pxrbportibn of childrer/ in the Gordon model 
making no p^Sive rasponses at all. Since this^va^i^le {frequency 'of 
passive responses) does not ^^ar to interact strongly with the * 
Gordon model, between-modfel dirferenoes do not,. in rny- mind, p>se a 
major problem, * "rfiey are, liowever, 'ej^lored further in J^penc^^x B,- 
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lew < '2,0; for corrpc^tenoe low < 4.0):'^ TWo-wa^^ analyses of covaxiance 
have been pferfomoed for each variable, using as dependent variables 



PSI and lO pc^t-test and gai/is. . flh analyse^ ' are done by.'mcx^l and 
frequency- of behavior, using the categories high and low. ' 



A. Passive Ffesponses • . ' 

. *7V response is ^oded "passive" when the child nade no response-, ^'^ 

• verbal orptherwise^ to the item. ""QaildrBn are considered ."high" on 

• thi$ variable if they make any passive responses at all (the median 
for the sanple being 0.0) . 

On all four analyses of oovarianqe — PSI gain," PSI ppst-test, IQ 

gain, IQ post-test — the main effect of^passive res^nse is onsignifi- ' * 

cant. . In effect this means that wlien a^l^ progr^jre were considered 

together lihe covaxied post-test scores and gains of ciiildren making 

no passive responses do not-diffel: significantly *from those of 

children making one or^mcore sudi responses. ^ '4 -I 

/'^ The interaction effects vary in^mgnitude ^cco'rding to the . ' " 

analysis; the signific^oe of the overall interaction ranges from 
* ■ ' - -1^ 

■4he question arose -as to whether using ra^ frequencies of a code, 
rather t^an percentage of ccorrect or inodrrect answers,- would distort *' ^ 
the analysis. Hie argunent was that bfi^ter children wojd-d have more 
' right answers and fewer wrong ones' than dull children and would, ^in 
.dtansequenoe, -have more opportunities to "extend" and.fes^r occasions 
for substitutions, passive responses, etc. This is n^^in fact tlie 
case,; because eadi diild, regattiless of his'IQ, starts at the level 
wher^ he passes all tests and stc^ at tJie| leyel where he failb'\all 
tests'. In consequence,, the correlation betweei^' nunt>er of iteira 
correct and IQ is .051, v^ich is insignificant (cjorreliations done for 
antire PV IQ sanple; n = 315) . ^' 

Ihe sanple for tfiese analyses consists of children for whom the 
' Planned Variation stucfy has valid pre- and post-test data for both 
the PSI and the Stanford-Binet; n =■ 305) . * 
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.163 for the covarieci IQ post score to .067 for IQ gain. ^ ' ^ 

We might predi-Ct frcxu Table Vllb^ that Far West, Tucson, " 
Vfeikart will shew greater cognitive gaixis Vith children Vow in passive 
resffenses, v^le Engelmann-Becker, Bushell, and Bank St^^t would show 
positive effects for those hii^ in passives. Once again, the observed 

V 

interaction pattern d6es not follow the direct! veness ,oontmui^ 

strictly,, but the two behaviorist prograirs do fall together, both* 

• 

favoring the gairis of children hi<^^ passive "besponses, 

B. Qonpetenoe' " . ' ' 

The code "conpetence " is u^ed for any response by which the child 
indicates he i^ unable to solve the problem, OpiLnarily this rreans 
say!^g "I don't kncw.'^ or "I can't", although there are other ways of 
oohTTTonicating the s'hrpa ne'ssage, Ihe frequency of sudi irespaises 
•increa^^s sharply from fall to ^pring-r;t^ting (the mean nuirber per 
child going from 4, 7. to 7,8)., Interestingly, this change is not in *• 
the nurrber of children making any sucii responses* (69% in the fcdl'and 

66% in tlie Spring) but irt the nunber usi'ng this. response. quite f^- 

< * * . 

. qijently; the'peroenta^. of chilc^nen iteking more than 10 siich responses 
rises from 11.7%* to 24.5%. One mi^t guess from this data that/ 
"ocaipetenoe" responses' are not a strategy one learns '^in preschool, but 
on^ which, if . already ^ mastered, gets frequently ^<Ercised there. .Ihe 
main effect of "ooiTpetenae" responses is^ignif leant f^r both IQ 
analysei, favoring children vAio make many sixh responses. It is 
ihsignific&it for tlTid PS I analyses. 

The evidence for an- interaction between freqijency of "oo^rpete^pe" 
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- Part i 
Table Vllb* 



^ - 



Interaction of Frec^puency of P^sive Responses? Witii Moc^l • 
Analysis of COvarianoe: Adjusted Effec±£ Greatgr man 1,0** 
. ' 1969-70 PV Data * ^ ^■ 



Analysis 



Positive effect for 
c±iildren lo/f in- ' 
passive responses 
(no passive responses) 



Positive, effect for 
ci*iildren high in 
paiisive responses 
(one or.noiB pSssive 
responses) 



0 ^ 

PSI Gaiji- 


Far Vfest +1.657 
. TUpson ±1,471 

Vfeikart .±2.745 ' ^ 
\ m: ' / ±1.885 


» St, ±2.582 
Engelmann- ±1.869 

Becker 
B\j6hell f2.567 - 


PSI £>o3t 


/ Weikart ±1.795 
EDC * ±2.028 


V Bank St. ±2.744. 
Engelmann- ±1.2 31 
' Becker / . 


id Gain 


Far^West i4.844 
Tucsqn ' ±1.025 


Bushel! i3..750 
EDC" ±1.317 ■ 


IQ Posk' ' 


Far: West . +4-.017 


Gordon +2.418 



*A1> sites .included in all four anal:ases . ... , \ 

■^♦Covariates -included sex, raoe, preschool e^«perienoe, family si:^e, \ 
incbne, and age. Pre-sor^re was 'inducted for thje two post-test 
' analyses , but not for qains' analyses . Soe page 32 for e>qplanation 
of adjusted offecta.- . - ■ ' 
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• ' ' * * 

res{XDnse and oogriitive gains .in particular models is neither strong 
nor consistent. The overall interactipn effect is insignificant for 
'^1 'analyses (the closest ^proadi to* significance, is^ in the IQ gain 
and PSI post analyses'; p =^ .093 for one and .125 for the other) , • 
♦.Furthemnore, the wi thin-program' interaction effects are not totally 
consistent for tl^e four analyses '(see Table VIIc) .' • 

The pattern of effects, though' sorae^iat mi^ced^ suggests* that 
/the "directiveness " continuum might be relevant to , interactions of 
"conpetence" with .model: Engelmann-Becker shows effects favoring 

4 those low in cohpdtenoe regpons^ \^le Bank Street ^appears t)enef it 
those high in" such^T^sponses. ALthou(^ interactions of EEX: and Far 

V^st with -this v^ariable do not meet opr criteria for proposing a 
specific hypothesis for the two models, bpth^show sijfis of favoring 
childjran high in, corpe'tanoe responses. For Biashell, Tucson and 
Weikart nodels\different ^nalyses show contradictory patterns, ' • 

C. SiiDstitutibns and Extensions • * , 

J- & 

A response is coded "si±>stitution'* when a child sifcsti tubes an ^ 
activity of his own choosir^ for -the problem posed by the tester. It 

♦ 

is coded' "extension" if, after responding correctly, he goes" beyond 
the requirements of the task either veibally or non-verbally. All ' ^ 
analyses of oov^cianoe done for these two variables show highly insig- 
nificant main effects 'and interaction effects.^ 'The inagnitude of sudi ' 
< inter acticiffis as do appear is sitblLI enou^ to nBke further consider^^ 
*tion of either variable appear pointless., 
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Part I 
Table V^c* 



Interaction of Frequency of Ccnpetdnipe Responses with Model 
Analysis of Oovarianoe: Mjusted Effects Greater Than 1,0** 

19 69 - 70 PV Data . 



Analysis 


Positive fqr those 
low in oorrpetenoe 
responses (0-3 
oonpetenoe responses) • 


Positit>e for those 
hi<^ in conpetehoe 
responses (mord thart^ 
4 oonpetenoe responses) 

— ■ ' 1 




PSI Gain 


Engelmann-Becker Vl,497 • 
Bushell +2^797 


Vfeikart , ±1.083 
Far Vfest ±1.794 
Tucson. +1.313 
Bank St. ±1.470 




PSL Post, 


Far West ±2.402 
En(^lniann-Becker ±1.546 


.Bank St. ■ ±2.449 
'EDC ' ±1.234 




Gain ^ 


Tucson ±2.049 
Vfeikart ±1.101 


Far Vfest ±5.114 
Gorcbn ±1.350 




IQ Post 

f 


Tiicson * ±1.676 . 
Weikart tl.SSl 




Far Vfest . ±1.255 
Bushell ±1.774 



*A11 sites "included in all four analyses. 

**tovariates^^ inclixSed age, sex, race, preschool experience, ingore, 
and fandly'size* See page 32 for explanatic^ of adju&bed effecba. 



D. Discussion 
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The results of the analyses of oovarianoe for the foOfr child 
variables derived from Hertzig-Bircii ccx3es suggest that two of the 

/ ' ■■ ■ ^ - 

variables — frequency of passive response and frequency of oojrpetenoe 

response — may interact with model characteristics / and that, the two 

others aln::st certainly do not, yt- ' 

The data suggests — weakly — that, both for pass ive^ and for conpe- 

tenpe response's, the modelTrby-chilc! variable intera(!±iQn may 'relate 

to the '*dire^tiveness" continuum. Specifically, chilfirsn high in 

oonpetenoe resppnse^ and/or low in passive responses ^>pecur to" do. 

better in less-directTve models (EDC, Far West, Tucson) while, oop- 

versely, -those Ic^ in oonpetenoe responses and/or high in passives do 

$Qmewhat oetter in the more-structured models' (Engelirann-Becker ,anQ 

Bushell) . ' This formulatioi^ is not hard and fast (Bank Street falls 

with Engelmanri-Becker and Bushell in favoring those lev/ in passive 
/ - 

responses) , but* it appears to be of .some use. 

These patterns make intuitive sense : it would seem that both 
these responses indicate sonething about a child's edacity — and 
willingness — to deal with cognitive prc±)lems that' he finds difficult, 
•Saying "I . don't know'., or in some other way directly ackiv>vledging 
ignorance, seetms to be a fairly^^cibiTpetent response; it: is ^Iso a 
response vrtiich' will oftefi result in adults si?3plying the need infor^ 
mation ^d skills, Conplete passivity seems, on the other hand, to. 
tie a less cqjrrpetent response' and, in a classroom v>Aie re adults as 
well as children have a good many pedagogical 'dioioes , one that^ -may 
lefes frequently lead to learning. For these reasons we might ej^ct 



diildren lav in passives arid high in corrpetenoe responses' ±0/ utilize . 
aault resouroes relatively well in less-directive classroone.' Ihis 
skill might be less of an asset in a nt)re-directive classroom and, 
indeed, the diildren least able to mobilize adult resources on their > . 
own roi^t hevi^ti^vxy^t fronf'a hJL^ly-directive aj^roadi', * ' 

Another consideration which may be iirportant is the degree to, 
which a model provides gioidelines for dealing with* the'^particulai: 

behavior, Bai-ik Stnset may show an interaction favoring children hic^ 

\ - ' 

in I passive responses beciiuse^of a particular model enphasis on with- 

dra>ni,. unresponsive diildren. Miere the model acts to focus teadier's 

attention on a particular groip of children »it may benefit these 

d;iildren unej^ctedly. * ' ^ /> 

Hypotheses 

* Weak— Based on 1969-70 Data . " , 

1. Within-model interactions will favor children making few 
oonpetenoe responses in EngeljTBnn-Bedcer programs.* In 
Bank Street programs, interactions will favor those making . 
irany sudi conpetanoe responses v More -generally^ in more^ 
directive proyrdiio interaction effects v*ill favor diildren 

'making few oonpeterioe ipespOTses, vMle in less-directivie 
moddls they will ^flkvor diildren making many sudi responses, 

r 

2. Within-model interactions yill ^a^^r -duldren making many r 
passive responsq^ in B^ik Street, Bushell and Sngelmann-Becker 
p^tograiTB; in Wfeikart, Tuason and Far Wsst prog^rane int^^*- 
action effects will favor thqse making few passive responses. 
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. .VIII. SLMMAI^y OF PART I AND GENERAL PREDICTIONS ' . 

' • ... * 

..." ; . ■ ' 

Specific Interaction Hypotheses ' ' ^ A , \ 

The 1969-70 Planned Variation data, in cx)n unction with selected 
•preschool studies has sugj^ested the ' following hypotheses about speci- 
fic interactions of cliild characteristics and preschool irod^l vniich 
we might expect to observe* Ihese hypotheses have-be^n discussed-. in " 
the pr^pedinq sections. ' A sumnary li^ is given be'^.ow. * 



Initial Ability ' • ^ . . ' ' ?' 

Strong / . ^ . • 

1. Less-directive models will shew interactions to.'oring ^ 
children of highintial IQ ori the PS I post-test.- 

2. Vfeikart programs will shw^ stronger tendency thaih oth^r 
progranB to Increase the variance of IQ scores. 

Weak - Based on 1969^70 Data "^r- 

/ ; ■ ' ' 

^ '3. In Gordon programs within'^jrodel interaction effects 'on the 
' 'PSI will, favor children of low initial IQ. The va^^iance 
• ' of IQ scores \vill tend to decrease in this modirfT^ 

.. . ,. ■ . , - . 

Prior Preschooling * - 

. Strong - ' „ , • - - 

1. ' Ihe cognitive gains of children having previous 'preschool - 
^ 6xperi^nce will be snaller than those of children having no 

such experience. . • ,\ * . ' . 

2. Children with a particular type of preschool experience ; 

• ' \ ■ ' ' ' " ' ' \ ^ ' ' ' 

Y , * will make greater seoond-year iQ.ga^ in a- program which 
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^ - 

J i different from their first experience than in one which 
. similar to it. • . ^ : 

3. Childraj;! whose fiist pa?^diool .e3$)erierioe was in a hi^ly- 
struc±UDed program will be more likely to maintain "br^^ 
IQ gainfe during the secxsnd preschool /ear than 



increase! 



Sex 



childie^ v;hose first-year prqgrim was leas^ structured. ' 
4. Children r^xng large, IQ g^ins in their first preschool 
' year will make sijialler gains during the seccaid year than 
children making negligible gains the, first year. 
.Children of lav initial id will inake greater gains during 
the eeoond year o£ preschcxDlirig than children of high 
"initial IQ. . ' ' ' \ 

6. Children of lew SES will make greater second year tD gaihs 

than those of hirh SES . i . 

. ^ - 

Weak— Based on 1969-70 Data ' 

7. .In Tucson and Bank Street programs, interaction effects on 

•r ' - • 

both cognitive measures will" ra^or children with previous 
presch9oling; in Gordon programs, interaction effects will 
favor children without such experience. In Qngelinann- 
Becker programs, interaction ef^cts on the PSI will favor 
J^^^ without ..previous presd^tol e^^ierience. 



Strong ' - ; ^ 

There will \>e no oonsistent main effect of sex on cognitive 
ou^oorge measures* 



2, ^Witnin jnodels' the effec± of sex on cognitive gains will 
* * differ from site to site. 
Weak— Based on 1969 - 70 Data^ 

3/ In Tucson and Far West sites IQ differences" will favor boys; 
in Bushell sites IQ differences 'will favor girls. 

" ■ C 

Age 

- . 1 ■ . . . 

Weak— Based on 1969-70 Data ^ , " 

1. The^ relationship between ^ge and adjusted post-score on PSI 
arid IQ- tests will be stronger and nore significant for child 
ren without previous j^reschool ej^rienoe than -for children 
with it^ " . ^ 

2. For children without previous preschooling, age will be ^ ' 
positively related to IQ and PSI ppst-test in Tucson and 
Bushell sites In-other nplels the relationship between 
age and post-test score will be negati\fe. or very weakly 
positive. 

Socio-eoonondc Status * • ^ - " 

Strong ■ ' • ' , 

1. Within-ntpdel effects will favor high'^^^SES children in the 

Weik*art nodel. 

Weak— Based on 1969-70 Data 

' ~ - ^ ^ 7 

2. Ihe overall interaption beto/een-SES and irodel will be 

. insignificant* fc2^ both the PSI and- for the Stanfbrd-Binet* • 

■■> , 

3. Within-model interaction effects en 'the Stanford-Binet will 
favor low SES children in Bank Street and Far Vfest programs. 
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Ethnicity - ... ^ ' ' 

Weak—Based on 1969-70 Data ^ 

1. Within-"program interactidn effects will favor white cliilclren 
% ' in Engelmann-Becker/ ana Tucson programs and Black children 
in Bushell porograitBv '"^ 



Response Style 



Weak—Based on 1969-70 Dat a ) 

ft - - ^ 

t 



1. Within-Kiodel interactions vjill favor childr^ making fe^ 
oorrpetenoe responses in Er^lmann-Becker programs. In 

^ Bank. street progranB, interactions will favor those making 
inany such conpetenoe responses. More generally /In mere" 
directive prograitB 4J^teractiQn''effects will favor children 
V^making few ooirpetence responses^ Miile in less^directive ^ 
. * models they will favor children making many such responses, 

2, Within-model interactions will favor ciiiXdren making nany 

pa^ive responses in Bank Street, Bushell and EngeLrann- 

... ' ^' 

Becker prograitB; in Weikart, Tucson ahd Far Wfest programs . 

interaction effects will favor those n\aking few passive 

responses , ' ' - ' . ' - ' , 

General Pjcedictions - \ 

— f / ■ ; 

The introdiaction to this. rep9rt raises three general questions 

about interactions. First, which 'characteristics of children 'interact 

most strongly with models — and, oonvBtseJiy, 'which are least inport^t' 

in terms of inain effects and interactions? Second, vAiat are the *^ 

patterns of such interactions as do appear? .?Vxe the categories and 



cx>nsideratian3^ which ot±ier .researchers have used for classifying 

progranB relevant to the interacrtions we observe? - And tl^rd, ho^ , 

iirportant are interactions in e^laining oognitive outocrnes of pre- 

school prbgraiTB? Neither the literature reviewed h^re nor the 1969- 

70 PV data provide filial answers to these three questions, but they 

do suggest some hypotheses. ' 

In answering ti^ first question — thot of the v relative inportanoe 

'of different child variables in predicting inte^ctions with mode^ — 

it seems wise to consider not only the size and significance of 

interactions ctoserved in the 1969-70 analysis , but also the degree 

which these interactions are^consistent across ^'-^sts, and the 

interpretability of the pat'(::erns' observed^ Using these criteria I 

would make the following predicrtions : 

1. Predictafc>le , significant, interactions of model with 
ethnicit y and SES wilf not be foundl 

2; For nost models the effect of sex on test score will be 
sirall. For one or two models, ho^fe^r, the effect of this 
variable will be predicted) le and significant. 
\ ^- , ' . ' ■ 

■ 3. An ^^fil^efpre table inceracticoi of age with model is unlikely. 

, 4. Interactions of nodel with initial achievemsnt y prior 

presdiooling , and t±ie two response style variables " passi- 

» yii^" and " conpetenoe ", irey follow patterns which are both 
predictable and interpretable . 

Ihe seo6nd general, question raised in the introduction oonoems 

the patterns of ' observed interactions and the relevvioe of categories ^^^^ 

whicti Qther researchers have used for gjcoipin^ppeschool progranB to 

the » interactions examined here. Ihe patterns of ■ interactions observed 
s 

^ on 1969-70 PV'data have been ^scussed in the preceding ch^ters. 

— ^ 

Ihe groimng schema used by other researchers are helpful in interpreting 
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interactions of model with certain child variables. * M^st of these 

schemes relate in one wa^ or another to the degree to which children's 4 

e>perienoes and behavior are directed by the teaching adults, Ihe 

interactions reported in the preceding pages suggest the following: • 

.5. The "directiveness" continuum may apply to interactions.^ 
of initial ability, prior preschoolingr and "conpetenoe" 
with ijodel; if art exqeption is made for Bank Street, this 
dimejTsron iTiay ^>ply to interactions wi^ "passivity". 

6.. Uie dimension of directiyeness does not ap^)ly to inter- 
actions of model with sex. Interactions observed on* the 
IQ m^^ure may relate to quite another aspect of the leam- 

* ing environment: the degreie to whidi adults use concrete 
objects in their teaching, 

'Ihe tliird question we set out to answer is the most general : hov 

unportant are interactions in explaining the cognitive putoomes of 

preschool programs? Can it be said that no one model produces maximum 

gains for all types of children? Here again our answer m>jst be tenta- 

'ti\^, but the eviderupe of the 1969-70 data is that interactions of . 

particular vaifiables with model are quite inportant in e>plaining 

t5ogniti\e outoomes. For this analysis model effects are stronger on 

1 . ' 

the PSI than on the IQ. Hc^^^ver, there is no one model or type of 

model which produces optimum gains for all types of children on either 

measure. f 

7 . None of the eight models will produoe optimum gains for all ^ 
types of ^children across both cognitive measures. 

Model effects are significant ^r the PSI post-test analyses. They 
favor the achievement of ch^-ldren in Ent^lnann-Becker and Bushell 
models. Model effects on the Stanford-Binet are insignificant. Had 
the Fort Walton Beach site been included (See Appendix C) ^±iere would 
have been a- significant model effect favoring Weikart. 
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PART II : 
ANALYSIS OF THE 1970-71 PV D^A 
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Introduction to Part II 



^ The hypotheses proposed at the end of Part I have been tested 
an the data generated in the second year of the HSPV study, 1970-71 • 
Somewhat different methods of analysis have been used on the second 
year of data; the^ differences are described in the sections that *' 

I The analysis of the 1970-71 dat^ has two objects. The first is 
the testing of hypotheses. The second is a fuller exploration of the 
interrelations between the independent variables selected for study, 
and the relation between these variables and the ei^t models of 
preschooling. Part II, like Part I, is in seven sections / each one 
* organized around the hypotheses proposed in Part I. /j^hese sections 
describe the analyses used, report the results, and slpnrTarize consis- 
tencies and inconsistencies beb^een the tavo sets of data. Patterns 

* 4 

suggested by the 1970-7i-^data are discussed. ; 

- The Sanple > . ^ 

The sanple for 1970-71 is siinilar to that us^d in 1969-70. ■ Each 

of the eight sponsors"'" was responsible for inplenenting his irodel in- 

thr^ to five states. The cites were designated level I, II, or III, 

Planned Variations -collected demographic inforration on children and 

staff in all sites ; in levels II and III cognitive tests were also ' 

given. In level II sites these included the PSI but not the Stanford-Binet. 
. I 

•twelve sponsors were actually involiied in this second year of Planned 
Variations . However, because of the' strategy of hypothesis generation 
adopted in this report, only the eight nrxtels who were involved for , 
both years have been considered. 
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In level III Igites t±ie PS J and other tests were gi.ven to all children. 
In addition the*Stanford-Binet was given to a randomly selected half 
of each class. ■ 

In oonsequenoe, the saiiple of children, for whan IQ data is avail- 
^le is considerably smaller than the sairple of children with' valid 
PSI scores. Specifically, tiiere are 305 Black and v^ite children 
enrolled in the ei(^t moctels for whom there are valid pre- and post- 
IQ and PSI scores. Ihere are a total of 883 children in these eight • 
ntxiels for whom HSPV has- spring and fall PSI scores. In addition.; 
there is a pool of control children; these children are enrolled in 
regular Hecld Start pEograms in, the same (or ccnparable) oonmLinities. 
as the various PV classroonB, but no sponsor is atteirpting to inple- . 
^ment his model in their classroorm. Ftor the ei^t models of preschool^ 
ing examined in tliis report, the^ are 305 xx^htrol children with valid 
scores on Ps/ and IQ pr^- and post-*tests, 

Ihe Analysis ^ 
J The 'analysis of the 1970-71 data, is directed at three general 
categories of question. First, wtiat are the first- and seoond-order 
interactions of these child variables with the ei^t modals of pre- 
schooling: do girls make greater IQ gains in Bushel 1 while boys fare 
bettfer in Far West; do children with' prior preschooling out-score first- 
year children in Tucson .and Bank Street, but not in Engelnann-Bockor? 

•'■Both Indian and Spanish-speaking children are* excluded from these 
analyses. For other explusions see Part I, ^^jpendix C» 



103. 



Second, what interactions not involving model significantly affect 
. children's p:ffeschool achievement? Is it true, for e^canple, that ' 
children of*, la^^^ SES show greater gains in the second year, of preschool- 
ing than trie first? Third, does grouping model^ as "more directive" 
and "less directive" add anything to our understanding of observed 
interactions b&cween' model and diilfl variables? , Do interaction effects 
become larger \^^en sev^al models are pooled together in a ''model gtoup" , 
or do they wash out entirely, due to between-model differences? 

The first set of questions — thofee involving interactioris with 
model — have been investigated throu^b analysis of covariance and 
regression.''" Analyses of covariance ^ne used to evaluate the magni- 
tude and significance of model interactions with six categorial 
variables. These are sex/ preschool e5qi)erience , ethnicity, SES 
category ^^and the two' response style variables "passivity" and "ccxn-, 

' pe^ence"; Regression analyses are used -to investigate interactions 

* ^ , - * 

with several cohtijiuoCis variables: initial I.Q, initial PSI score," 

- ' • \ : t_ 

-'-The 1970-71 analysis includes only oovaried post-test scores. Raw 
gain soores^ are not ajialyzeci separa^tely in Part ,11 because tliese 
interi^fcctions appear on tha 1969-70 analysis to be; quite similar tjo 
post-test interactions. S^oe the PSI -and IQ ted€s are significantly 
correlated a multivariate analysisAJf covariance might have been^done. 
However, the two tests are analyzed separately for two reason: ■ first 
the PSI sanple facilitates ccitparisons which WQu3jd ptherwise be 
inpossibie. Second, although the tests are correlatied (.541 at pre- 
test; see ^^>pendj.x E) model effects op the two measui:gs ar^ quite 
diff^ent (see Shiith, M.E., Sane Short-term Effects of ..Project Hea& 
Stcirt; A Preliminary Report on the Second Year of Planned Variation , 
1970-71^ Huron Institute/ 1973) .' AltjiQugh the reasons for obserVfed 
differences ^re not, always evident to the writer, it may be illumin- . 
ating to the reader if the discrepancies are made ^parent. . 

^For description of the SES measure, see Part I, Section 5. 
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age, and three SES canponentS; mother education, incxDme and family 
size, i^pendix D gives further details oxgall analyses. Regressiais 
are referred to by nurrber. in the text. V 
^ Effects and interactions riot involving modsls are e^lored in a 
general interaction study analysis of oovariance. The sanple for this 
investigation is all children either in Planned Varia(tions " (sponsored) 
, or .conparison (unsponsored) classrooms with 'valid pre- and post-tes^t 
^ee^s on both the PSI and -the Stanford-Binet. Ihe primary j)urpose - 
of .this analysis is to test hypotheses conoeming the achieveirent of 
children with prior preschool e:<perience . * . 

Vlien discussing a nunber of preschool jpodel?^ one is tenpted to 
groip them in ^ome way. In the introduction to Part I 'it is noted 
that although^ researchers have ised a variety of principles * in groip- . 
irig models, nany of the resulting schemes have a good deal in oonmDn. 

Models v^ich assume that adults should take a very directive role for 

r \ \ ' . ' ^ 

a good part of the teachingvda^ are put in one groip, while models 
* wfiich assume that children should generally have choices about vrtiat,. 
they do (and how) ^d ip in another • ^ome models don't fit either, 
description;, in consequence, nearly all researchers usfe three or morp 
categories . ' . ' ' - 

' In Section VIII of Part I, I suggested that concepts gomTOn to. 

•A 

these traditional groiping schemes may be useful in predicting and 
' interpreting interactioris with particular child variables . In the ^ 

1970-71 analysis hypotheses relating to these groipings are investi- 

^- ' «. , * 

gated through regression analyse:^ vAiich are referred to in these 
pages as "groiped-model" regressiorts. Ihese anises' are intended 
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to contrast models where. adults .take a hi^ly directive role vd.th ^ 
iTTodels ill whicii diildren make many significant chdioes about hcK — 
and with whan — to spend their time, Bushell and Engelirann-Becker are 
plaoed in a "mors -directive " groip, v^ile Far West, EDC and Bank Street 
are plaoed in a "less -directive'^ one. In order to make the two gpoip? • 
as different as possible on the score of teaching strategy, the^ other 
three inDdels, Vfeikail:, Tucson and Gordon, are omitted from these 
analyses. ^ 

The groupings, and the choice of models to be included, are 
based on sponsor madel descriptions. Bushell and Engelmann-Becker 
are placed in title more-directive category because in both models child- 
ren's major learning is alleged to teJce ^lac^ in adult-directed 
^roips where, decisioas' about what is tau^t are made by adults . Al- 
though adults in several other models are €j$3ected to plan sinall-groip 
•lessons (e.g.., Tucson) , the adult is generally ej^jected to take account 
of the children's conrents^and demonstrated interests as he prboeeds. 
-Thus , the actual form of the lesson is 'supposed to be determined by 
children and , teachers , wjrlcing toother (as in Vfeikart's "open" pro- 
grams v^ere both' adulcs arid children are expected to initiate and to 
respond CWeikart, 72] ). 

Far West, EDC and Bank' Street 'are grouped' together bs less-direcrt- 
ive because they enphasi2;e the iirportanoe of the choices made by the 
individual child in his learning.' All of these sponsors see the 
process of inSking these chioioes as essential to learning.' None of 
them ej^^ect children to spend the major pirt of each day in an organ- 
ized groi^i, working" with * an adult. 
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Weikart and Tucspn have been omitted because they are seen as 
falling somewhere between these two groups. Although these moctels 
emphasize the innportanoe of choice-making, both appear to eypect 
, children to spend a significant part of each day in small groups with 
an adult. Althou^ in practice either of these modsls mi^t look 
quite a lot like the "less -directive" models , the structure for learn- 
ing described by sponsors seejjB to direct the outcome of children's 
choices a bit more. The gordon model is cSmitted because it contains ' 
no sp^ific directions for classroom practice. • 

•iVie Classroom Cbservation data si:pports the nqtiai that practice 
in Engelmtinn-Becker and Bushell classrooms is quite different frym 
that in other models (see Lukas and Wohll^, 72). Engelmann-Becker 
and Bushell are significantly above all other hiDdels (p < .001) in 
total academic activity, and in frequency of adults with children in 
academic activities. They are below other models in* independent child 
activity, with Bushell being significantly low (p < .001) • Bank 
Street, Far Wost, Tucson, and ^IC rank higjiest on- this variable. In 
general the evidence for placing Engelmann-Becker and Bushell in the 
more^irective groip is stronger than that binding Bank Street, EDC 
and Far West together.. However, these three programs do show evidence 
of considerable independent child activity^ both academic and non- 
academic. 
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I. INITIAL ABILITY 



Section I of Pai:t I utilizes three- resources iii formilating 

hypotheses concerning probable interactions of preschool model' and 

initial ability: data presented in selected pre-school evaluation 

studies, Bar-Yam's revisv of certain ^titude treatrrent ipoteractioh 

studies; and the 1969-70 PV data. On' the whole the investi]5^tion does 

rpt reveal strong patterns of achieveaiient v*iich are consistent across 

a nurrber of studies and measures. It do^,^ however, suggest three 

hypott^eses: ' . * . . 

.■ • V 

Strong hypotheses ^ 

1. * Less-directive models will shew interactions favoring 

children of high initial IQ on the PSI post- test. 

2. ^ Weikart programs will sha^ a stronger' tendency than 

• J other programs to increase the variance of IQ« scores , 

Weak hypotjtesis 

3. In Gordon p:cograms within-model interaction effects on 
the PSI will favor children of lew initial IQ: The 
variance of IQ scores will tpnd to decrease in this^ 
model, ' , ^ 

The last of these predictions is derived solely from the 1969-70 
PV data; the first two are sijpported by the findings, of other 
investigators. 

None of these three hypotheses is oonfirmad^ as it stands, by 
the 1970-71 PV data. However, the analysis of this sedond-year data 
does suggest that the interaction of model and initial ability will be 
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along the lines of our hypothesis- when the PSI rather .than the IQ i:est 
is u^ed as the^measmfe of initial ability or achievernent. 

The 1969-70 analyses enploy tvvo strategies for exploring interactions 
of initial ability .and iTtDdel.- ' First ^ tJie variance of pre- and post- 
test IQ scores are contrasted in eadi of the ei^t' models-. Second, 
children are stratified ^according tjo tlieir initial IQ score andlthen 
the relative performance of 'liigh" and "low" scoring groips are ccm- 
pared v;ithin each model. 

Ihe approach .used- in tiv^ 1970-71 analysis- is different in two 
vjays. First/ children arc grc;uped on the basis of PSI prG-soorc as 
well as . IQ pre-score. Second, tlie -initial ability measures are con- 
sidered as continuous rather tJian categorical variables. Tb permit 
this more efficient use of tlie data./ interactions are explored through 
regression rather than (as in the 1969-70 data analysis) analysis of 
'oovarianoe. 

Ihe 1970-71 PV Data: Results of Hypothesis Testing # 

Hypothesis 1: Less -directive models will shew interactiions 
favoring children, of hi^ initial IQ on the PSI post-test. 

Itfis hypothesis is based on the 1969-70 PV data and on" results of 

certain ATI studies of olcter children. Ihe first-year PV .data shw 

interactions favoring the PSI achievement of hi^ IQ children in . 

oert^n "less -directive" models (Bank Street, Tucson, and EDC) . Ihere 

is no substantial interaction effect for either of the "irore-directive" 

models, Engelmann--Becker and Bushell. Bar--Yam, in a suimary of ATI 

researdi, reports a similar pattern: in stlidies she reviews the effect 
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of Lnitial ability' level on a^ieveiiBnt appeaxs to be strongest in the 
more "permissive" programs. 

In tHe 19,70-71 analysis, the groiped-model rejjressions are use3 
to test J^jgothesis 1. In these analyses QigeLTV-jm-Becker and Bushell * 
are classified as "norB-directive" while EX/Bank Street, and Far 
West arfe-grouDed together as "less -directive", Ihe results of this 

? ' 

analysis do not oon firm the h^potl-iesis as it stands . They do, 
hcvever, suggest an interesting revision of it. 

Independent variables in PS^ regression 4a include rrodel-group 
(as defined above) , family size, mothar-'s education, inoonB , "oonpe- 
tenoe",''" 'ipassivity", sex, ethnicity, prescliooling, age, PSI pre- 
score, IQ pre-soore^^ all first-<)rder interactions involving iTDdel- 
group except nodel'-groip-by-PSI-pre-soore , and selected second-order 
interactions (se0 Appendix D for oonplete list of independent varia- 
blqs) * This analysis shows the ,nrdel-groi$)-by-IQ pre-soore^ interaction 
to be significant (p '< .05) biit in the opposite direction f jpom our 
prediction (see^ Table la). 

In PSI regre^ion 4b ,^ the variable "nodel-grpLp-by-PSI-pre- 

score" is sdDstitUbed for ''iTC>del-group-by-IQ-pre--soore". This variable 

is significant (p < .001) and in this case the effects are in the 
\ - 

■'■''Corpetenoe"* and "passivity" are two child variables derived from the ' 
child's responses to the IQ test. See Part I, Sectioji 7 for an 
e jqplanation , , . . , 

^Hesull^ of PSI regression 4b are used in preference to those for the 
'larger sanple PSI regression 3 because the distribution of initiail 
scores for .this sanple poses a regression problem — children in one 
gro\p pretest somesAhat higher th^ those in the other groip. There 
are no ^uch betweien-group "differences for the smaller sanple. 
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' • ■ < Part II 
Table la 

Interaction of 'MDc3el-Groip With IQ Pre-Score 
Effect on PSI Post-Test Score 
.(From PSI Ffegressiori 4a-Grovped ^i^dels) 
1970-71 PV Data 



Variable Description Standardized Coefficiejgt Significance 

IVbdel-Groip (less. directive * 

vs, more-directive) .0l9 J NS 



IQ Pre-Score ^ • .330 . 001 

Group-by-IQ-Pre-Score .106 .035 

1_ L2: 

- Effects on M justed PSI Post-Test Score^ ^ 
(Given in StSa^dard Deviations) 





Bank Street; HDC, 
Far Wegt 


Engelmanri-Becker ; 
Bushel 1 


low Initial IQ. 




, 


(One SD Below Mean) 


-.243 


-.417 


Hi^ Initial IQ 


/ 




(One SD Above Mean) 


+ .205 


+ .455 



Dumny variable: Bank Street; EDC and Far West coded -1; Engelnann- 
Becker and Bushell coded +1. ^ 

^Effects giveA in the table '^nbine .rtain effects of the two variables 
and the interaction. 
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Part II 
Table lb 



Interaction of Model Grovp With PSI Pne-Scorc 
Effect on PSI Post-lfest Soore 
(From PSI Regression 4b-Groiped Models) 
1970-71 PV Data 



Variable Description Standardized Coefficient Significance 

Model-Gro\p (less-directive ^ " " 

- vs. iTiD re-directive) .165 .025 

PSI Pre-Soore .436 - . ' .001 

Group-by-PSI-Pie-Score -.215 .001 



Effects on Adjusted PSI Post-Test Soore 
(Given in Standard Deviations) 



2 



Bank^ Street, EDC, Engelirann-Becker , 
Far West - Bushell 



Lew PSI pre- 

(Qne SO Belav Msan) ^.816 -.056 

Hi^ PSI pre-* V 
*^ (One SD Above Mean) +.486 +.386 



"'"Diimy vari^le: Bank' Street, EDC and Far Wfest ' coded -1; Engelnfann- 
Becker and Bushell Ooded +1. ' ' 

2 

Effects given -in table conbiae cain effects of ^t|oth variables and 
,the interaction. ' . * « 
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preiictad direction. The effect is more siijstantial and significant 
(see Tab'^e lb) than that of rodel-group-by-IQ-pre-score . 

Ihe group-by-PSI-pre-score i.nteraction is exactly as Bar-Yam had 
led us to anticipate: for <±iildrBn of hi^ initial score tlie effect 
of curriculum (meaoiing mDdel-group) on adjusted post-score is small, 
but for tiiosG of lew ini^al score, curriculum has an effect of about 
three-quarters of a standard deviation, witii'^'children in the more- 
directive models scoring hic^er. 

T^e difference betwe&i- interactions observed^ for IQ and PS I pre- 
score probably relates to tlie fact that the PSJ: is not normed for 
age. E*igh-scoring children, therefore, tend to be older as well as - 
smarter. For this ^rair^le, the PSI pre-score is positively correlated 
with age (r =^.448) and with IQ (r = .404) - Ihe IQ pre-score is, 
on the other hand, negatively related to age (r = -.145) . Nonetheless 
the obser^d interaction does .nDt^apparentJ.y reflect -the effects of 
age alone: the mD^3>groip-by-age interaction is insignificant in ' 
both equations. Apparently a measure utiich CGrrbines the effects of 
age and ability predicts achievement differences more powerfully than 
age or IQ alone. ^ 



Hypothesis 2 : Weikart programs will show a stronger tendency 
than other prograire to increase the variance in' IQ scores. 

Table Ic gives the variance in IQ and PSI scores , fall and spring 

for all eic^t models. Variances are reported separately for children 

with and wijfchout pricu: preschooling. Clearly the hypothesis is not 

confirmed. Pre- and post-test variances do not differ significantly 
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for any model . Havever , for three models , Tucson , Bushel! and 
Gordon/ the variance in IQ scores does increase; it does not increase 
for the Weikart model. , . 

Hypothesis 3: In Gordon programs, within-^nodel interaction 
■ effects on the PSI will favor children of lev; initial IQ. 
The variance of IQ soores will tend to decrease in this model. 

This' hypothesis is not confirmed. T^ble Ic shows that for 
children in Gordon programs the IQ variance • increasfes (insignificantly) 
between fall and spring testing. 

PSI regression 2 has been used to test the hypothesis oonoeming 
ncdel-by-initial-IQ interaction in relation to PSI post-test score. 
Independent variables include models, incoms, mother's education, race, 
"cctnpetence"^ ^ age, PSI pre-soore, IQ pre-soore, interaction of 
model with mother's education, income, "conpetence" , race, age, anc^u 
IQ pre-soore, and interactions of race and age with these variables. \ 
The mpdel-by-initial-IQ interaction is significant "{p < .002) for \ 
Engelirann-Becker; it is insignificant all other models . For 
Engelmann-Becker the interaction favors children of low "^initial IQ, 

Discugsion . 

Three points" energe fram the 1970-71 analyses. The first is 
that the structure and imgnitude of an interaction of model with initial 
ability or achievement depends on vdiat measure, is initially used to 



"Hertzig-Birch variable; see Part I, section VII for explanation. 
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categorize children. For these preschool analyses, interactions 
on the PSI are in one direction vrfien children are classified on the 
basis of initial IQ and in the qpposite direction when the PSI pre- 
test is used to group them. The greater magnitude and significance 
of the PSI-by-iTDdel-interaction suggest that, a broad neasure of 
initial achievenent is more useful in predicting interactions than ^ a 
measure which is adjusted for age.. ' : 

Ihese results fit well witli data reported in Stodolsky's study 
of children's transition behavior (72) . Stodolsky locked at the ways 
diildren wove from one activity to another in a free chdloe situation. 
Slie reports correlations of ago, mental age and IQ witl\ frequency of 
each of teQ behaviors (tyipes^^^ transitions, peroentagc of time spenc 
in activity , ete.) . Correlations of all observation variables with 
IQ are trivial, while correlations with mental age (Stanford-Binet 
score before age norming) are significant (p < .05) in six out of 
ten cases. (Correlations with age are even stronger than correlations 
with mental age; this may relate to the greater reliability of the 
age measure) . 

Stodolsky's results suggest that a measure which is not normed 
for c^ge will give far nore infomiation about a child's actual cleiss- 
rocin b^avror than one v^ich is. It is therefore not surprising tl'iat, 
in our analyses, PSI pre-soore interacts more strongly (and more 

interpretably) with model- type than did initial IQ, 

■ -^^ ' ' \ 

The seoond point emerging from the^e analyses is that the struc- 

\ •• , ^ - 

ture an interaction riHy be quite different when the outcome 
measure is" dian'ged^ Hie interactions of 'm^del-groip and model with 

1 
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IQ and PSI pre-test are signifidant only on PSI post-test analyses. 
On IQ analyses botli interactions are insignificant,^ So, althou^ 
these data indiqate that nore-directive nrxJels favor the PSI gains 
of initially lav-sooring children, they give no evidence of a similar 
pattern on the IQ test. 

These results are in line with findings of ATI studies (see. 
Cronback, 1969; Bar Yam, 1969) that the structure of an interaction 
may often depend on thQ outcone sou^t. This -fact should be bonie 
in mind for all results reported in these pages. When an effect 
favors particular ^children in a particular model, the terptation is 
to say that these children -''benefit" note. Yet often the advantage 
is specific to a particular test— V7e cannot assume that it extends 
to all cognitive measures, much less to the many other objectives of 
preschooling. 

The third point is that the diirension of directiveness does 
appear, in a^very limited and specific way, to affect interactions of 
initial achie\'BnEnt with model. *Bie PSI gmiped-model regreasions 
shOff a sitstantiaX and highly significant interaction of PSI pre-test 
and gtoip; this ihteraction is in the predicted direction,"'' 

In sum, the 1970 -71 PV data shows that when the PSI is used as 

a measure. ^of initial aaiie\^ment, children's perfonnanoe .in the PSI 
- ^ ^ . - 

llhe strongest interadti6ns .of PSI pre-soore with model are for EDC' 
and Engelmanii-Becker. PSI regressicHis lb. and Ic both show hi^ly 
significant interactions (p < .01) for these two models ^ For EDC . 
effects favor high--scoring children while for Engelinann-Becker'the 
opposite is true. 
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post-test .follows the patterns viii<±i the ATI literature had led us to 
predict, and that the interaction of achievement with model is si±>- 
stpintial, particularly' fox initially law~scoring children. Beyond 
this, the analyses indicate that the interaction cannot be generalized 
to other cognitive tests and, in particular, does not apply to IQ. 
Ihese findings are not^Strong, but they are of interest, particularly 
as they dictate caution in generalizing across measures. 



* 



II. PREVI013S PRESCHOOL EXPE31EENCE 



Seven hypotheses relating to the effect of prior preschooling 
en children's achievement are proposed in Part I. 

Strong Hypothesis , j . 

1. Ihe cognitive gains of children having previous pifeschool 
e;^rience will be srra,ller than those of children having 
no such experience. 

Weak HypQth^ses 

2, Children with a particiiLar type of preschool experience 
will makq greater seoond-year IQ gains in a program whidi 
is different from &eir . first experience than in one which 
is_ similar to it. 

Children v\^ose first preschool e??)erience was* in a hi^ly- 
structured program will be more likely to maintain or increase 
IQ gains, during the second preschool year than children 
whose first-year program, was less-structured. 

4 . Children making large IQ g^ins in their first preschool 
year will rreke smaller gains during the second year than 
children making negligible gains the first year. 

5. Children of low initial IQ will make greater gains during 
the second year of presciiooling than children of hi^ 
initial IQ. 

6. Children of low SES make greater second year IQ gains 
than those of hi^ .SES. 

7. fn Tucson and Bank Street prograne, interaction effects on 
both cognitive measures will favor children with previous 

^ preschooling; in Gordon programs, ioiteraction effects wii:^ 

favor children witliout such experi^ce* In aigelmann- 
Becker programs, interacticn effects on the PSI will favor 
ihose' without previous preschool ej^Jerienoe . 

Ihe first six hypotheses are based on' data reported by other 

researchers; the first one is si^ported by the 1969-70 PV data. The 

last prediction is based on the 1969-70 data alone. 
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■ Ihree hypotheses (1, 6 and 7) have been tested on the 1970 - 71 
data. Hie hypothesis which rests sole'ly 'on the data of other investi- 
gators is not. oanfirmed. Prt^dicrtions based on the 1969-70 data are to 
sane degree sj^)ported by the seccjnd year's analysis. 

Ihe results of the^ 1970-71 analyses suggest that we may be able 
to predict vrtiat models and what type of np<fel will prove especially 
effective in raising scores of children with prior preschooling. The 
analyses do not indicate that oertciin types of children will gain 
more from a second year*"of preschooling regardless of the character of 
tl:ie program. 

The 1970-71 PV Data: Results of Hypothesis Ttesting ^ - 

Irlypothesis 1 : The oogrvLtive gains of children having previous 
' E^reschool experience will be smaller than those of children 
having no such e>!perienoe. 

The^ general interaction analyses of covarianoe have been used to 
test this hypothesis. Four. analyses ha,ve been dene, with IQ post- , 
test; PSI post-test, IQ gain and PSI gain as dependent variables. €he 
design i% "carpetenoe""'" by ^'passivity'*"'" by preschool experience by 

ethnicit^by SES. PSI pre-test, IQ pre-test, and age are covariates 

1 2 
on the pc^t-test analyses; age is a oovariate on gains analyses. 

The effect-of preschool ej^Derienoe is significant (p < .001) on all , 

four analyses. Differences ir* g^ins, adjusted for the pDvariates 

gi\^ above, airount to five points on tbie IQ (children with prior 



^See Part I, Section 7 for e^qjlanation of these variables. 
2 

For more details on analyses see i^^pendix D. 
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preschooling gain 1.1 p>oints, v^ile those without it gain. 6.1 points). 

Hie difference in gains is four points on the PSI (8.5 points for 

those with preschooling versus 12.5 for those without); ihe hypothe- 
1 

SIS is confimied. ^ 

Hypotheses 2, 3, and 4 : ^ 

2. Childien with a particular type of preschool' e^^rienoe will 
make greater second year IQ gains in a prograin vAiich is 
quite different from their first experience than in one 
which is siirdlar to it. 

3. Children whose first preschool experience was in a 
hi^ly-structured program are more likely to maintain 
or increase IQ gains during the second preschool year 
than children v^ose first year program was less structured. 

4. Children making large IQ gains in their first preschool 
year are less likely to make sv±>stantial gains during 
the second year than children making negligible gains the 
first year. 

Planned Variation's information on the character of children's 

previous preschool experiences and on their cognitive gains prior to 

entry in the model is not adequate to penntt testing of these three 

hypotheses. ^ ^ 

Hy^thesis 5 : Children of low initial IQ will make, greater 
gaxns during the second year of preschooling than children of 
hi^ initial IQ. 

In Part I, Section' 2 the term "initial IQ" is used* to refer to 
the child's IQ at the beginning of the first preschool year. For 

children with prior preschooling this information is not available 

^» • 

•'■Nevertheless , as is pointed out in Part I , the gains of second year 
children are not trivial when oonpared to the gains to be expected 
for audi children were thdy not enrolled in proachool, Sae Smltli, 
Marshall, Sora Short-tern EfCactfl of Project ttead Start; A Prelimi n- 
ary Report on the Second Year of Planned Variation" 19 70 -71 , nxxixm 
Institute, 1971, ^ 
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to the Planned Variation Study. Incaeed, most childreif had never been 

tested before tiieir participation in Planned Variatjtons. Therefore, 

the hypothesis as it stands coiLLd not be tested. 

\ ' ^ * ^ 

Hypothesis 6 : Children of lew SES will 'itBke greater seoDnd 
year IQ gains than children of high SES, 

Ihe: general interad^don analysis shows "children of low SES 
making significantly greater IQ gains than those of high SES in both 
the first and the second preschool year. This effect seene, however, 
to result mainly from- their lower prescores, since the/effect of SES 
on oovaried post-- test soore is insignificant in the general inter- 
action analyses.. Ihe IQ analyses show no significant interaction <^ 
either of SES or its conponents (family size, mother education, and 
income) with presdicoling. 

Hypothesis 7 ; In Tucson and Bank Street programs , interaction 
.effects on both cognitive measures will favor children with 
previous preschooling; in Gordon prograirs interaction effects 
will favor children without such e:>$)erienoe ; In Engelmann- 
Beck^r programs, interaction effects on the PSI will favor 
those without previous preschool e:<perienoe. 

/ 

Table Ila giws the estimated oortbined means on the PSI post- 
,test for children with and without prior preschooling. Interaction 
effects are significant for Tucson (p = .006) , oonfin!?lng the hypo- 
thesis for this model. For all ot&er modslS^ interaction effects are h 
insignificant. 

- Because the IQ sanple is snaller and ^aTEV^*lat unbalanced with 
respect to prior preschooling, the hypothesis as stated.here could 
not be tested on the Stanford-Binet dat^. It is, however, possible 
to tast the broader form of the prediction vAiich is given in . 
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Section 2^ Part J: 

. In a more generalized form C the hypothesis 1 mi^it be stated 
"child-oentered" progranB will shav interaction effec±s favor- 
Sing second-year cJiildren while prograiiB v^ere the initiative * 
lies primarily with adults will shav interaction effects 
favoring first-year ciiildren, 

4 

This hypothesis is confinxed by the grouped- model regressions. 
In IQ regressions la and lb the interaction of model-group with prior 
preschooling is significant (p < ,005) and in the predicted direction. 
Table lib shows dilldren with no prior, preschooling gaining somev^at 
more in jrore-directive models v*iile seoond-year children appear to do 
si±)stantially better in less -directive programs, 

'Discussion 



Part I, Section 2 raises two questions about the effect of prior 
preschooling. First, are there some categories of children wno, 
regardless of model, benefit rvor:^ than others from a second year of 
pineschool? Second, do some educational approadies work particularly 
well for children with p^ior preschdol experience? Hypotheses 
relating to both q\jestions are proposed,. Specifically, it is sugciested 
that children of low SES and low initial IQ mi^t benefit more from 
a second preschool year; it is also suggested that children v^o had 
faiXi^d to make substantial gains in their first year of preschooling 
mi^t b^e\iore likely to gain in the second year. Not all these hypo- 
fences can be tested on the PV dat^, ^It has, however, been possible 
to investigate in considerable detail the possibility that some 
children gain more than others from a second preschool year, and the 
results of this ^nvestigiatian are essentially negative. The general 
interaction stVx^ re^^^ls no significant interaction of priooj 
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Part II 
Table lib 



Interaction of Moc3el-Groip with Prior Presciiooling 
Effect on Stan ford-Bine t Post-test Score 
(From IQ Regressiai 2a-Groiped ^iDdels) 
1970-71 PV Data 



Variable Description Standardized Ooefficient Significance 

Model-Groip (mDre"dir|ctive -,123 ^ .147 

vs, iess-directi\^) ' - ' \ 

Pr .schooling^ ^ .184 -006 

Groip-h^y-Presdiooling .203 .004 



3 

Effects on Adjusted IQ Post-Ttest Soore 
(Given ^ in Standard Deviations) 



it 



Bank Street, ETC, Engelr:.-^nn-Becker , 
/ ^ Far West ' Bushexl 

^ Prior Presdiooling -I-,142 -.510 

No Prior Presdiooling , , ' +.104 +.264 



iDunry variable: Bank" Street, EDC and Far West coded -1; Sngelmann- 
Becker and Bushell coded +1. 

^Dumny variable: children with prior presdiooling coded -1; those 
without such e^^rienoe coded +1. , . 

3 

. Effects given in the t^le ooitbine main effects of both variables 
and the interaction 
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presdicx)ling witKs^x, age, ethnicity, SES, or either cx^gnitive style 
neasuie. IQ regression 2 PSI regression 4 reveal no significant 
int6rac±ion of previous Vpresiii*^ wi^Ji the three SES oonponents. 




family size, nother's education in(X)m^. Althou^ jndoiibtedly 
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soiTE children benefit more than others from a second year of pre- 
schoolv there is no evidence that these children can be described 
in terns of the variables used in this report. 

Although the 1970-71 analysis does not isolate one group v\rtiich, 
regardless of program, bene fits- .more than other groips from a second 
pre^c^hool year, it is somewhat- more success ful .in locatirig mDdsls 
which are particularly beneficial to children v^th prior presc^ooling. 
Where significant interactions of preschooling with model or model- 

9- » 

qroxjp (models groiped as "more-directi^^" and "less-directive") are 
found, they tend to support the hypothesis that more-directive models — 
or ones v*iere, in Wsikart's ternB, adults initiate — will favor the 
aciiievement of first-year children, v4iile less-^<iLiBCtive pc^els-^ 
those v^ere. the child initiates — will favor the achievement of seoond.- 
year children."'" Althou^ the* interaction of model-groip with pre- 
schooling is not consistently significant in PSI anedyses (PSi rer- 
;gressions 4a and ^) , it is significant (p < ,005) for the IQ 
analyses. Table lib indicates that for diildren with prior pro- 
fechooling, model-grovp makes a siJostantial difference: children in 
tlje less-directive models outsoore those in more-directive models 

,%iejUin effectVof model-groip ("more-directive" vs. "less-directive") 
on IQ post-test score is not significant. 
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by dx)ut two- thirds of a standax-d deviation. For children without 
presdiool e^^rien.oe^ the effect is smaller but in the opposite direc^ 
tion, as predicted. 

In Part I, I suggest that in irodels v^a.ch require children to 
make choices and take initiative, children with earlier school exp^jr- 
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^enoe mic^t posseiss an advantage relative to those without it, v\^iile 
ill mDa:B-directive mDdels this mi^t not be so, U'lese data si^port 
that interpretation y althou^ within-model effects in the PSI are not 
totally' consistent across the two yecurs of data. . ^ 



/ 
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III. SEX 

•Neither the preschool studies reviewed in Part I nor the 1969 

70 PV data lead us to expect strong interactions of sex and nodel. 
Of the thiree hypotheses proposed in secticn III of Part I the two 
stron^gest — those based ipon the findings of other researchers as well 
as on the 1969-70 PV data — are essentially negative in character. 

Strong I^^theses 

\ 

1. Ihere will be no cons\^tent main effect of sex on cognitive 
outcome measures, 

2. Within models the effect of sex on cognitive gains will 
differ from site to site*> 

Vfeak Hypotliesis 

3. In Tucson and Far West sites IQ differences will favor boys; 
in Bushell sites IQ differenoes will favor girls. 

The pattei^ns suggested by the 1969^70 data and by previous 
research on preschooj. achievement are 'in general repeated ins the 1970- 

71 analyses: the effect of sex on test scores is for the most part 
small; v^^ere interactions of sex and model are predicted,, the observed 
effects are in the predicted dirdcrtion, but do "not reach significance. 
However, analysis of the 1970-71 PS I data^s/t^gests that althou^ tlie 
interaction of sex and mDdel rray be trivial when the sanple is <^CIT^- 
posed of children witi.out prior sdiool e>5>erienoe, it nay be consider- 
ably more significant after the first preschool year. 
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The 1970-71 Data: Results of Hypothesis Testing 



» 



Hypothesis 1 : There will be no consistent rrain effect of sex 
on post-score and gains for PSI and IQ. 

' Tl^s hypotheses is confirmed. The General. Interaction Study 

analysis of covariance shews insignificant effects favoring boys on 

both the IQ post- test and the PSI. Tliese effects are very small: 

.15 points on the Stanford-Binet (.01 SD's) and (l.36 points (.13 SD's) 

on the PSI. For the PSI sairple" (PV only) , by contrast, regression 

analysis shows a ^mall (,56 points/ .05 SD's)'^ut significant effect 

favorihg girls on the PSI post-testV These effects are neither 

large nor consistent. 

Hy^thesis 2 ; Within models 'the effect of sex on cognitive . 
gains will d/ffer from site to site. 

. ^ The effect of sex on adjusted PSI ^ post-scoi'e is trivial in all 

models:; Table lila gives the estimated oorbined means for boys and 

girls on the IQ post-^t^t. These means are adjusted for IQ and PSI 

pre-soore, age, preschool ejq^erience, SES* and ethnicity. For five 

models (Tucson, Bank Street, Engeimann-Becker , Weikart, and EDC) 

Planned Variations has relevant IQ data for children in more than one 

site. Differences bet>^een'the scores of boys and girls are trivial 

(less than one point) or favor boys in all Gordon, Engelmann-Becker 

and Tucson sites. In the two Bank Street sites differences favor ^ 

girls. Sex effects are in opposite directions oKly in EDC sites. 



Hypothesis 3 : In Tucson and Far West sites IQ differences 
will favor boys; in Pushell sites IQ differenoes will fa^^r" 
^ girls. * 
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Table Ilia gives the estiifiated oonbined IQ neans for boys and 
girls in each of the fourteen test sites. For all sites exoeptsite 3 
sex effec±s are in the predicted direction; they are not, however, 
^'significant. 

It is suggssted in Part I that the tendency of oertain rrodels to 
favor the IQ achievr^irent of boys — the Far West mocfel in these PV 
analyses, Montessori in Bissell's analysis — may relate to an en^Siasis 
these prograiTB place on learning through manipulation of concrete 
objects. Althou(^ interaction ]effects favoring boys are not statis- 
tically significant (due, probably, to the small nuniy^r of children 
in Far West classrxx>nB) , they are in the direction predicted. This 
suggests that the possibility of such a program enphasis being parti- 
cularly favorable to boys ' IQ gains should perhaps be investigated by 
other researchers who have moye classroom observation data available 
to them.' 

* , 

Discussion 

In relation to sex the 1970-71 PV data fbllcw the patterns 
observed in the 1969-70 data. First, main effects of sex are strall 
and not consistent 'aqross the two oognitive* tests. Second, sex"" 
effects within models are soms^^at greater for the IQ than the PSI. 
And finally, sex effects on thcr Stanford-Bine t are in the direction 
hypothesized for the th±iee itodels for which predictions were mawte. 

Although the irbdel anellyses indicate that we may be able to. 
predict the direction Vf sex differerujes in a *fe* models, they provide 
no evidence that these dif^p^renoes v/ill reach '^.evels of statistical 
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or educational significance.. Ho/ev^r, the 1970-71 groiped-nrdel 
PSI regressions raise the suspicion that, in fact, differences between 
the achieveitient of boys and girls within a particular type of curricu- 
lum be* iTore sifcstantial after the first preschool year. All PSI 
groiped-ntxael regressions show a s\±>stantial and significant second- 
order interaction involving sex, irodel groip, and preschooling. (The 
interaction is in the sane directicn on IQ analyses, but is far too 
small to reach statistical significance.) Table Illb gives the magni- 
tude and direction of effects. For children without prior preschool- 
ing the relationship between sex, model-groip and achievrrihrnt is 
basically additive, with girls achieving more than boys, and children 
in directi^^ models achieving more than those in less-directive models. 
For children with pre-school experience, however, ^e situation is 
different. Although main effects continue to favor the achievement 
, of girls and of children in more-directive programs, the sex-by- 
Irodel-group interaction is strong: in Engelirann-Becker and Bushell, 

^ t>oys outscore .girls by about one-fifth of a standard deviation, vrtiile 
in less-directive models , girls outperform boys by nearly one-half a 
standard .deviation. Table Illb suggests that curriculum assignment 
affects the ac±iievement of beys with prior preschooling ore than 

that of first-year boys. 

These results are not easy to explain, but they do raise some 

^ interesting questions. W/iy doeS model assignmant havs so little 

effect* on girls' scores and so strong an effect on the achieveiTBnt of 
seoond-year boys? Why do seocnd-year boys outperform second-year girls 
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Part II 
Table Illb 



InteracTtion of M^del-Grotp, Sex and Prior Preschooling 
Effect of PSI Post-Test 
(From PSI Regression 3-Groiped Models) 
1970-71 PV Data 



Variable Description 

Groi^^ 
Sex^ 

Preschooling 
Groip-by-sex 
Grovp-by-sex-by- 
preschooling 



Standardized Coefficient Si gnlfi canoe 



.184 
.069 
.087 
.073 

.101 



.001 
.034 
.020 
.087 
.014 



Effects on Adjusted PSI Post-Test Scaore 
(Given in Standard Deviaticns) 

Children with No Prior Preschooling 





Bank St. 
Far West 
EDC 


Engelnenn- 

Becker, 
Bushell 


Bays 


-.138 


+ .174 


Girls 


-.056. 


+.368 




Children with Prior Preschoollfig 




piank St. 
Far West 
HDC 


Ehgelmann- 
Becker, 
. Bushell 


Boys 


-.514 


+.202 


Girls 


.028 


-.008 



^Dumty variable: Far West, EDC and Bank Street coded -1; Engelmann- 
Becker and Bushell coded +1. 

^Boys coded -1; girls coded +1. 

-hto prior preschooling coded +1; Prior preschooling coded -1. 
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Effiects given in the table nain effiects of all variables and interactions, 

A * 
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in iTore-diiBctive models? Will the differences c±>served for children 
with prior preschooling Carry over into the school yearfe? 



/ 
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IV. AGE 

Althoi:Qh the studies reviewed in Section I show no interp ratable 
pattern of age-by -program interaction, several researdiers report 
results which indicate that within particular prograuB age may ba 
strongly related to gains. The 1969-70 PV data is consistent with 
this : for children without prior preschooling the relationship 
bet>/een age and cognitive gains appears to be different in different 
npdels, and, within models, renarkably consistent acroe the two 
cognitive tests. FurthentDre, the age-by-model interar tion observed 
in this first year of PV data does not appear to relate to identifiable 
features of ?V inodels . , • , 

On the basis of the 1969 - 70 PV data "b^o weak hypotheses are 
pix^X)sed: 

1. Ihe relationship between age and adjusted post-score on 
PSI and IQ tests will be stranger and wore significant 
for children without previous preschool experience than 

for childj:en with it. ^ ^ 

2. For children without previous preschooling, age- will 

be positively related to IQ and PSI poat-test in Tucson , 
and Buahell sites. In other rrodels the relationship 
between age an^3 post-test soore will be negative or very 
weakly positive., 

Neither of these predicticMS *is made with great oonfidenqe, since the 
author was unable to ar^rlve at a plausible explanation of the observed 
interactions.' Neither is confirnBd by the 1970-71 analysis. For the 
1970^71 PV data the pattern of age-^Dy-model interactions is the same 
for children with and without prior .presiiiooling. And the Bushell 
model, far from favoring older children, shows a weak effect favoring 
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younger children on the PSI, \ 

The 1970-71 PV Da*-^; 'Results of Hypothesis Testing 

Hypothesis 1 ; The relationship between age- and adjusted post- 
test score on PSI and IQ tests will be stronger and more signi- 
ficant for children without previous preschool e>perience than 
for chj.ldren with it. 

This hypothesis is not donfirmed. The interaction between age 
and preschool e:<perienoe is not significant on any analysis of PSI 
or IQ post-score. 

Hypothesis 2 : For children without previous preschooling, age^ 
will be positively related to IQ and PSI post-test in Tucson 
and Bushell sites. In other models the relationship between 
age and post-test score will be negative or very weakly 
positive. 

The possibility of age-by-model interactions has been investigated 
tiirougti regressio^ analysis. "'^ These analyses, IQ regressions 3 and 
PSI regression 5, use only children without prior preschooling. Indepen- 
dent variables in IQ regression 3a include mDdels, IQ and PSI prescore; 
sex, age, ethnicity, SES and r^ponse style variables., and sel^ected 
interactions v*iich are significant on previous analyses (see i^^pendix D) 
Interactions of age with the Tucson and Bushell ntx3els are forced in. 
Both are insignificant. In IQ regression 3d main effects are foroed 
in and all age-by-model interactions are permitted to' enter stepwise. 

In the 1969-70 analyses the relationship between age an3 covariod 
PSI and IQ post-test scores was investigated thpou^ regression equa- 
tions. A separate equation was used for each laxtel (see Part I, 
section IV for a list of other variables in the equations) . The • ^ 
regression equations used for the 1970-71 analysis include children in 
all ei<^t models; age-by-nodel interaction temB are used to evaluate 
the significance of differences between models. 
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None are significant. 

Inc3ependent variables in the PSI regression inofucte irodel, 
family size, irother's education; income, sex, race., age, PSI pre- 
sooxe, and the tovo-way interactions of all these with nrxdel, age 
and ethnicity. Uie main effect of age is insignificant. The age^Dy- 
model interaction is significant (p < .005) only for Engelniann- 
Beckor; it is negative as predicted. The age-by-irodel interaction 
is insignificant for Tucson and for Bushell. 

Thus, the. 1970-71 PV data does not support this hypothesis. 

Discussion 

On the whole, the 1970-^71 PV data tend to support the prediction 
made earlier (section VIII, Part I) that an interpretable interaction 
of age with model is .unlikely* These data do not oonfipn either hypo- 
thesis generated- from the 1959-70 data. Purthermore, such interactions 
as are obser\^d are not consistent across the two tests. 

It is, however, of seme interest that in the 1970-71 PSI data, 
in contrast to th^ 1969-70 data, the two Behaviorist models, Engelmann- 
Becker and Bushell , seem -to fall together in favoring the achievement 
of young children. While these interactions are not significant 
across all analyses, efJ^cts cu:B^oonsi£. intly in this direction. Fbr 
the *less-directive models the picture is nx>re mixed; in oonsequenoe the 
groiped-model regressions show no significant interaction of age with 
model grcip* ^ 
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V. SOCIO-ECONOMIC STATUS 



The preschool evaluation literature provides anple basis 'for a 
hypothesis that the interaction of SES and model. will favor 1cm SES 
y^iTldren in hi cjhly-di recti ve rrodels such as Engelirann-Becker and 
Bushell. The 1969-70 PV analyses, hcvever/ raise the suspicion tJiat 
-althou^ this may be^rSQ in experiinental preschool studies, it is n^t 
true when the setting is Head Start. On the basis of these data, 
three hypotheses are proposed: 
Strong Hypothesis 

1, Within-model effects will favor high SES children in the 
Weikart ipodel. ' 

Weak Hypotheses 

2. The overall interaction between SES and model will be 
insignificant both for the PSI and for the Stanford- 
Binet. 

3,. Within-model interaction effects on the Stanfojrd-Binet | . 
'iyill favor lav SES. children in Bank Street and Far West 
programs . ' *• . ^ ' ^ • ' 

The 1970-71 data sijpport the notion that at least in the conp6xt ^ 

of Planned Variations Head Start, more-directive models are not oon- 

sistently more effective in raising poor children's test scores. 

w 

The SES measure 'used in the 1969-70 analysis ccnbines family Aze, 
mother * s -educational achievement (yearsi in school) ^nd income, 
standardized and wei(^ted equally. This measure is also used on the 
1970-71 data. Analysis of covariaiice done on PSI and JQ post- test 

— ■ — 1 " T 

'hhe procedure used to determine each child's. SES score* is described in 
Q"^ i, Section V. For the 1970-71 PV sanple, the meai^ aire as follcws 
||^P^(];ome, $4,350; mother's education, tenth , grade; household size, 5.4. 
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scx)res gives no indication of an interaction between SES-7S0 defined — 
and rrodcl. s' 

Because other researchers (see Part I, Section V) have found a 
fairly consistent pattern W SES-by-program iriteracti.ons , I have 
analyzed the 1970-71 data further, to see whether the corriyDner.ts of 
our SES measure, taken singly, interact rrore strongly with irodel^ and 
whether any observed interactions follcw the patterns, observed by 
Bissell (70) and others. 

Specifically, I wanted to teKxv, whether , witlran the PV sairple, nure- 
iirective models favor the adiievement of lav SES children, wtiile less- 
directive models favor the achievement of hic^i SES children, E\^eh 

lOugh this rs not tnje for a ponbine^ SES measure, it might have been 
true when SES was defined as income, mother's education, or family 
-size alone, A11stK>U(^ the observed interaction-s of SES oonponents with 
model are of .some^ interest, they do not indicate that low SES childten— 
defined by these measures — gain more in highly-directive models- 

Preliminary fegressicai analyses of PSI post-soores using main 
etfects^^and fnodel^-by- variable interactions of the three SES- carponents 
(PSI regression la) shew the main effect of all thr- aricibles to be 
insignificant. Significant nteractions with model are found for 
incoi^ and for mother education, but not for family-.* size* Since the 
effect of faitdly size appears to be trivial, a second analysis (PSI 
regression Ic) includes main effects ^and model interactions for the 
two ^remaining SES variables, race X preschool experience, age, 

PSI presdbre, and age-by--preschool interaction. (For a full list of 
independent variables, see Appendix D) . Ihis analysis shows 




significant ma.in effects both f or "mDther ' s education (p < .001) and 
for inoorne (p < .005) and significant interactions of both with nrdel. 

The direction of the observed effects sheds some light on the 
results obtained for the conbined SES measure. Although the main 
effect of iTother's education favors children vdth more educated 
n-others, the effect of inoorne is ip the, opposite ^ direction, with child- 
ren from poorer families doing sor^what better than those from less 
poor f^milier,'^- On a conbined measure these two effects cancel one 
another out. . 

The pattern of model interactions on the PSI is equally difficult 
to interpret: Engelmann-Becker shews significant interactions favor- 
ing lav -^income children (p < .001) and thpse \N^ose mothers have 
achieved a hr^ier educational level (p < .05) . Interactions ^of other 

models with SES boirponents are insigriif icant. 

^ ^_ \_ 

"hphese- results raise questions about the relationship between , these two 
vari^les". The observed main effects mi^it make sense if, due. to SES 
requirsements for participation' in Head ^ Start, mother ' s' education and 
income were negatively correlated. (This might happen if, fqr exanple, 
the incare^ ceilinig weire set lower for children of oolite educater". i 
parents than 'for those whose parents lacked hi^ school diplomas.) 
Alternatively, they mi^ht be dismissed as ^ tjie result of a suppressor 
effect if the interoorrelation was very high. In fact, however, tha 
cprrelatibn is positive (.158) , but too -srall 'to account fpr a strong 
sijppressor effect. (See 7^>pendix E for other interoorrelations in the 
1970-71 PV sairple J ' ^ ' . •* 

%here is some suppressor effect apparent here: the interaction of 
the Engelmann-Becker mDdel witibi incorre beocxnes Ic^er and mpre strongly 
significant Vijhen the interaction of irother's educational level with 
this model enters the equation. However, even when the effects of 
mother's education and inoom^ are considered quite independently (by 
examining the direction and magnitude of the* partial, correlations of 
each interaction term with the dependent variable on the step pre- 
ceding entry of eit:her intera-^tion into the equation) interactions of 
'the Engelmann-Becker model with tliese two SES . oonponents are in the 
opposite directionfl. 
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^ IQ regression Ic tests hypotheses relating to SES corrponents. 
Independent vairiables in this equation include models, faiully size, 
mDtl.ier's education, iiicx>me, conpetence, passi'^wdt^s sex, ethnicity, 
prior preschooling, age, IQ and PSI pre-score, and selected inter actJ.on 
of ba'ckgro-jnd variables which are significant ^in other analyses. 
Iritcractions of ^tiler's education, inoome.' and family size are allcwed 
for those models for whicli interactions ieenned likely. Specifically, 
with Weikart, Far West,. and Bank .street,, for which hypotheses had 
been proposed, cmd for Engelnann-Be£ker and Bustiell , which Bissell's ^ ■ - 
research identifies a!&s4 ike ly to be different. Main effects are signi- 
ficant ^r family size (p^ < .01) and inoome (p < .05) , favoring child- 
ren from smaller families with higher incomes » The effect of motlicr's 
educational level is not significant. Only the interaction vntli 
family size is significant for V^eikart, favoring smaller fainilios.' 
'V^eri other interactions are alloved to enter the equatioiT (IQ Regression 
la) effects are essentially the same except that interactions with P'ar 
We$t are replaced by a Significant interaction of inoome with the 
Goirtfon nodel. 

The 1970-71 .Data: Insults of HypotHesis Testing 

■ Hypot±iesis 1 : Within-model effects will favor high SES children 
in the Weikart model 

Interactions of SES cajpSnents with the Weikart malel arc not 
sicjnificant for the P^x post- test. However , for the IQ po^t-t^ist. 



There is also an effect favoring djiidfen from smaller families in 
Far West. . Hcwever, thig interaction only reaches significance after 
the interaction of this model with inoome enters the equation (not 
significantly) . Evidently the ^ize of thes^jDorrelated interactions 
is dependent on a suppressor effect. 
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L'io interaction with fainily s-ze is significant (p < .01) and m the 
predictxBci direction: children frcra small families do better in this 
ntxlGi . c 

Hv^^oQ-chesis 2 : The overall interactJon between SES and irodel will 
lye iiiisigrdf icant both for tlie PSI ar.d for the Stanfoixl-Binet . 

Tlie analyses shc^- tliis to bt^ true when a coiiDincd SLS ii^asLirc 

is used. 1 / 

\ 

V. 

Hypothesis 3 : Witlun-model interaction effects on tlie Stanford- 
Binet will favui SES children in Bank Street and Far West 
prograne . 

This h^^/potl^iesis is not confimred. Interactions of SES oortf-oncntH 
, with these two models are insignificant for both IQ and PSI analyses. 

Discussjo n 

Itiese aiialyses indicate that a cx^nbined SES measure is not very 
useful for looking at effects of family background on perfornonce in 
.Planned Variation Head Start mpdels. Perhaps thJ-s is partly because 
the SES sanple represented in Head Start is trxmcated; consisting 
nmnly of the very poor. Apparently^, it is also because aspects of 
SES interact witJi the preschool 'models in different and sometimes 
contradictory ways. 

On the whole, the interactions with model could not be said 'to 
follcw the patterns which the r ..lults of previous research had led us 
to expect. The studies s^jnmarized in Part I, section V and, more 
fully, in Bissell (1970) 'vould lead us to expect interactions favor- 
ing lew SES clv-ldr^ in Engelifann-Becker-and Bushell programs and in 
the reverse direction for less-directive models. Hwever, the 



cirouped-ntxtel regressions — PSI and IQ post-tests — shcv/ no signif icaiit 
interactions of irxxlel-group (rnore -directive vs. less-directive groupr^) 
wiUi-any of the tliree SES conponentSg Ai*d although tJie PSI model 
regression does shew a significant effect favoring IcM^-incoire 
children in Engelrnanri-Becker , the effect is in the opposite direction 
for the iTiothcr-education iiieasuiTj, favoring children whose motliers have 
achieved a higher edix:ational level. 

It can be argued that all of the PV sanple is poc^ and, in fact, 
corrparable to tiie Ifjv Si^ group in some other studies.''^ Aojording to 
tills argunent we migtit not expect SES-by-model interactions — the range 
of income, etc. , being siirply too narro/. Hc^vever, for an all-poor 
sample suchi as this we woald predict a strong main effect of model- 
group on bc^th cognitive measures; we would e^^x^ct the effect to favor 

/ 

more-directive models, The data does not support this Expectation: 
when tlie most-directive and least-directive models ai:^ contrasted in 
tiie grouped-model regressions, the main effect of nodel-grcup on IQ 
post-teist score is ins^gnificcmt (favoring less-directive models) . 
On PSI analyses the effect favors more-directive irodels, but its size 
and significance varies according to the other independent variables 
in tlie equation (oonpare, for exanple, Tables la and lb in Pari: II; 
the effect of model-gro\p is significant in one but not in the other) . 

''"M though the SES data from Bissell's study is not quite comparable to 
the PV SES data, the indications are that the two sanples are not 
very diff jrent. The median level of mother's education is between 9th 
and 11th grade for all three of Bissell*s sanples^ as conpared to ^8th 
grade for 1969-70 PV sample and 10th grade for the 1970-71 sanple. 
Median nunber of childre^.i in the family is 4 for Bissell's Urbana 
sanple and 3 for the Now Yoric sanple. This is corparable to the n^Ljan 
family size of 5.4 to 5.5 found for the two PV sanples. Inoono t^ata 
cannot be ocjn^:)^od. 



\\hy do the two years of PV data shotv a different pattern of 
•results from Bissell's? In part this niay be because the methods of 
analysis used are different. The PV analyses include more oovariates 
and interactions tlian did Bissell's, and it is possible that the addi- 
ifional independent variai3les may pick up some variance shared v;ith 
SES. This seerts especially likely on the 1970-71 IQ analyses / since 
main effects for PSI pre-scpre- and response style variables are 
included. Mcv/ever, this explanation is hardly a conpletje one, since 
none of these variables correlated above .131 with the three SES 
oonponenta (see /^pendix E) . Furtherrore^ these covariates are not 
included in -the 1969-70 analyses; for the first round of data, oovariates 
nore nearly reser±>le Bissell's, with only prior pre^chooling and age 
added to thie four she tised (sex, ethnicity, prescore, and SES) . 
Ihere is no particular reason to suspect that prior preschooling or 
age relate to SES , although Appendix E reveals an uxjexpectedly high 
negati^ye correlation between age and mother's educational level (-.197] . 

As Part I suggests, I would attribute differences between Bissell's 
results and those of tl^e PV analysis tQ^two differences between the tvo 
studies. First of all, the fact that the PV sanple is national undoubted- 
ly dilutes the strength o.": the SES measures. Second, the context of 
Head Start may chaiige the character of the models in iirportant and rele- 
vant ways. For exairple, pressure from parerjts and local cpirmonitins 
may force teachers in particular sites to concentrate on the most dis- 
advantaged childjnen. The ideology of local bureaucracies and bocirds 
may influence teachers' responses to econonic and social differences 
far more than the model does and hence may wash out SES-^y-model 



interactions. We cannot be sure v^ether this happens, but 
possibility wortii bearing in mind, j 

c 
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VI , ETONICITY 

The findings of previous preschool studies taken together with 

the 1969-70 PV <3ata do not provide a b^is for a strong hypothesis 

concerning ethnicity-by-model interactions. In the earlier studies 

reviewed the effect of race on cognitive gains is inconsistent. On 

the 1969-70 analyses, interactions of model with ethnicity are signi- 

ficant but exceedingly difficult to interpret, "Itie. two l>ahaviorist 

models, for Cixarple, shew opposite effects for ethnicity , with Bushell 

favoring Black children and Engeliriann-Becker shewing larger gains for 

white children. One weak hypothesis is proposed, based on the patterns 

of the f^yst year's data: 

Witliin-program interaction effects- will favor white children 
in Engelronn-Becker and l\icson prograiTB and Black children 
in Bushell programs. 

However, the puzzling pattern csf cbserved interactions raises the 
suspicion thatj, the observed^ interactions may have little to do wiUi 
enduring characteristicsnsfjaodels^and that althiou^i the interaction 
of ethnic:^ ty and model might continue to be of cxDnsiderable magnitude 
it is unlikely -to follcw predictable patterns, i 

This suggestion is supported by the 1970-71 xiata. Once again 
inter actions^^^ ethnicity and model are, significant or (on the IQ) 
very close to it. And once again they follow no consistent pattern,- 
The 1970-71 analyses support the notion that interactions of this 
variable with model da not relate to enduring characteristics of 

. - ■ . ' ' • . . ■ - . . < 

tlie models themselves. 
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The 1970^71 PV Data: Resijlts of ^Hypothesis Testing 

Hypothegife ; Wi thin-program interaction ef fec-ts will favor white 
children in Engeljiiann-Becker and Tucson prograjns and Black, 
children in Bushell programs. 

This hypothesis is not. confirmed. Interaction effects on the PSI 



post-test are significant (p < .001) f^r the Bank Street and Engel- 
irann-Becker niDdels, favoring v^iite.^hildren in Bank Street and Black 

> 

children :.n Gngelmann-Becker (see Table Via) . The effect for Engel- 
mann-Becker ii in the ofposite direction from that predicted ^on the 
'basis of 1969-70 da^. The interaction effect for Tucson is in the 
direction predicted, but does not reach statisticail significance, 
(p < .06) . The interaction of ethnicity and model is ^ not quite 
significant on thie IQ, analysis (p < .06) . In Bushell and Engelmann- 
Becker models effects are in the predicted direction,, but in6ignificai:t 
The interaction of model and ethnicity is significant only in the 
Gordon model. 

•Discussion 

The 1969- '70 ^^^loration of raoe-by-model interactions is-'limited 
at the start by" the face that onl^ three models (Tucson, Bushell and 
EDC) have enou^ Black and white children, to be included in bojth IQ 
and PSI analyses. The 197^-71 ^airpie is^ij^tisr balanced, permitting 
— inclusion of all models in both analyses. As it happens, the rargesL 
interaction effects in tliis round of data are IcJir models excluded " 
from tiie 1969->70 analyses. This, however, i^only a partial explana- 
tion of our failixre tq predict the ciservedl interactions. .Even for 
models included in both years' aialyses, there is little corisistency 
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between t;he two years or between the two tests (oonpare Tables Via and 
VIb in Part II, and Table Via in Part I) . Eng^ima-ji-Beckei' , for 
exairple, shews strong effects favD.ring wl-iite children in the 1969-70 
P6I analysis, significant effects fcworing Black children in the 1970- 
71 PSI analysis, and effects favoring white children in t]ie 1970-71 
anal;, 3S. Only Tucson shc^s a consistent pattern across the two years. 

What can we then .say about the interaction of ethnicity and 
model? This is'still^a puzzlirtg question b^ailse; on the one hand, 
intei^actions of ethnicity with individual models continue to be ' 
statistically significant — more significant than interactions with 
y many other variables — and, on the other hand, these interactions do 
not follcw any consistent patterns. 

In tliG 1970-71 analysis, ethnicity-by-model inceraction effect:^ 
^for the PSI do appear to rela^te to the "directiveness" continuum 
discussed in the introduction. In 1970-71, three of the less-directive 
models, Tucson, Bank Street, and EDC^, show effects favoring white 
children, vv^ile Engelmann-Becker , the more directive model, shews a 
. /ighly significant PSI effecft favoring Black children. However, no 
similar pattern is observed either for IQ sooires or for the 1969-70 
data/ Furthermore, interactions of ethnicity with model-group 
•{more-directive versus less-directiv6) are not significant fcr oiUiGr 
measure, presun^bly because of opposite patterns shab by cliildrxui in 
Engelmann-Becker and Bushell. 

These puzzling differences-, between tests do not, as one might 
suspect, result from site effects. It was noted in the 1969-70 data 
. ^ thau oontradictory effects or^the bvo tests for the EDC model 

ERIC 
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apparently resulted from one site, prirarily v^ite, scoring well on t^e 
IQ measure while children in the other site — mainly Black — did better 

A 

on the PSI. However, confounding of race and site within models is 
not a problem for t'»^e 1970-71 sanple. It is maii<:3d only for the 
Gordon sites, and this model happpns to show consistent effects for 
the t^o tests. 

We are left wi th the conclusion that although race-by-mDdel 
interaction effects appear to be more inportant than the main effect 
of race in explaining cognitive outcomes,''" these effects are neither 
interpretable nor predictable. The second set of data strengthens^ 
the suspicion aroused by the 1969-70 analyses, that abser\^d inter- 
actions pro\ ably have little to do* with identlifiable characteristics 

i 

either of ethnic groups or of models. They my result from idiosyn- 
cratic as^^ts of different sponsors' itiplementation s^irategies or 

from conditions within^ sites vvrtiich relate only indirectly to models, 

« 

or from some other factor not considered. 



^There is no consistent main effect of ethnicity on post-test score 
for .the 1970-71 analyses. Althou^ vrfiites score' slightly higher 
than Blacks on the IQ post-test, the two groups are not significantly 
different on the PSI post-test. 

^Race effects are reasonably consistent across tbk sites within a 
particular njodel. That the observed interaction^ are not entirely 
due to specifit: site effects is derronstrated by the fact tiiat the 
race-by-site interaction is insignificant for both outcome measures, 
while race-by-model interactions are significant, or very close to it. 
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VII- RESPONSE ST/LE' 



The Hertzig-Birds^ooring of the Stanford-Brpet gives inforrration 
about children's manner of ireetlng or a\oiding the demands of the IQ 
test. In tlie 1969-70 £malysis, this data is used to oonstinjct four 
"response style" variables. The, vari-ables are derived directly from 
four categories of responses: substitution, extension, oonpetence, and 

passive. (For description of ithese categories, see Part I, sec^tion 

I 

VII.) Children who, on the IQ pre- test, made more responses in a 
particular category than the sairple median are described as "high" on 
that variable. Others are ribed.as "low". Two of the variables, 
"conpetence" and "passivity" — named for the Hertzig-Birch categories 
on whidi they are based — show signs of interacting with model. This* 
if>eans tliat in some models children rated as "high" on "passivity" 
outscore those rated low on the variable, while for other models .the 
oppositje is true. ^ 

TWO weak hi^ theses, both derived errpir,^ally.' f rom the 1969-70 
analyses, are formulated at the end ot Part I, section VII: 

1. WithirT-model interactions will favor dhildron making fcv/ 
conpetence responses in Cngelmann-Becke^i^rograms . In 
Bank Street proyi.ams, interactions wijJPitavor those 
rraking nany such oonpetenoe responses. More generally: 
in more-directive programs interaction effects will favor 
children iraking few oonpetence responses, vrtiile in less-^ 
direct'i ve models they ^will favor children makir^ many 
sudi responses. s. 

2. Within-model interactions will favor children making many 
passive responses 'in Bank Street, Bushell and Engelmann- 
Becker programs; in Vfeikart, Tucson and Far West programs 
interaction effects will favor those making few passive 
response^:. 
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Tliese hypotiieses have beeri tested on the 1970-71 data, ihe pattern of 
interactions is remarkably siniilcxr across the two y'ea2:*s of data, 
suggesting that tliis type of variable rray be quite useful in predicting 
interactions with nrxiel. ' - • 

The 1970-71 PV Data; Pesult^ of Hypothesis Testing 

• Hypothesis 1 : . Within-ftiode^ interactions will favor children 
tnaidjig few donpetence responses in Engelnann-Becker prograins. 
In Bank Street p'rograire, interactions wii:|^ favor those making 
many qonpeten^ responses. More generally: • in more- 

directive progranfe . interactioYi effects wi,ll favor children 
making fa*/ oonpetencq r^ponses, v^il^ in l^s-directive mcdels^ 
they will favor cMldren. making ma^iy such responses.-: 

On the 1970-71 fall IQ ti^t, rrbst diildren*made .no'cx^npctehcx? 
responses at all. Therefore, children who made any sucfi rcsponii^es 
are categorized as "hi^r***;^ this variable, while those making no 
.such responses axe classified as low.' 

The modeHDy-ccrrpetence interaction is insignificant for both PSI 
and IQ model aiialyses. However, the grouped-model regressions dp show 
a significant (p < .005) interaction in the predicted direction for the 
IQ post-test analysis. Table Vila gives the magnitude and dir^tion of 
main effects and interaction effects on the PSI post-test. The effect 
of curriculum assignment on post-test score is small for children who 
nake no "oonpeteiice" responses on the IQ pretest. It i.s ml/(mJ))c, 
hcwever, for those making "oorrpetence" responses: otiier things being 
equal, such children score more than half a standard deviation higher 
on the IQ post-test v^en-assigned to "less-directive" rrtxiels. * 

The'gro\:p-4Dy-"corTpetence" interaction is not significanr on the 
PSI post-test analyses, although it is in the predicted direction. 
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Part II 
Table Vila 




Interaction of Model -Groip with "Conpetence" Effect 
on Stanford-Binet Post-Test 
(Fron IQ Regression 2a-Grouped IVbdels) 
1970-71 PV Data 



Variabla 'Description , S tandardized Coefficient Significartce. 





S 

-.123 . 

-.097 

-.165 

« 




■ ^ 1 

Group 

"Coupetenoe" 

Group by conpetence »• 


ns • . . 
ns 
.004 


Effects .. 


Bank Street, EDC 
Far West - 


EngeiiTunn-Bccker , 
Bushell 


Low in "oompetence" 
responses (0 responses) 


+ .055 


+ .139 


Hi<^ in "cortpetence" 
responses (one or irore 
responses) 




-.385 

-* 



■"Duimary variable: ^ a:ik So?eet, EDC, and Far West coded ^1; 

xjngelnann-Becker and Bu^ell coded^ +1. 

^i^fers to Hertzi^-Birch scaring of the Stanford-Binet. See Part I, 
section VII fd:^e5q:>lanation of tfiis variable. 



; H^potiiesis 2 : Within-nxxJel interactions will favor children 
making irany passive respons^ in Bank Street, Bushell, and 
Engelmann-Becker programs;" in" Weikart, Tucson and Far West 
programs, interactioiT effects -v^ll favor those making fev; 
' ^ passive responses , 

This hypothesis is confirmed by IQ data. Table vilb gives the 
estimated coirbined means for IQ post- test scores. The overall inter- 
action is significant (p < ,0-^1) , with effects in the orcdicted direc- 
tion for all iKxk^ls. Ttie interaction . is not signif icant on the PSI 
post- test analysis. , ; 

Discussion 

Interactions of the two Hertzig-Birch variables "conpetenoe" and 
"passivity" with model shew <^^te similar patterns across the t^vo years 
Confirrration of the hypotheses relating to these variables is i^t 
overvrfielmingly strong (no substantial interacMons are observed on tl^Q 
PSI analyses) . Nonetheless, the IQ analyses suggest thrit variables 
relating to cognitive sc^^le nay be* quite useful, in predicting wliich 
children will make substantial gains within a particular model. 

As observed in Part I , interactions of these variables, with model 
seem to be related in some degree to the "directiveness" oontinuuru, i 
Broadly, we oould say that more-directive models favor the achieve- , 
ment of children makirtg some passive a^id/or no conpetence responses, 
wliile the less-directive models affect more positively the scores of 
children making some conpebenoe and/or no oassive responses. The 
conspicuous exception to this formalation is Bank Street, vMich' falls 
with EDC and Far West in favoring childi^ high in con\x:^tcncc 
responses, but is closer to the behaviorist model, Bushell, 'witli 
respect to "passivity". 
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Wliat is the reason for tiiese patterns? Witiiout rlirect observa- 
tion in classrooms, it is impossible to be sure v^y a moclel produces 
more measurable grcwth for one ^roup than for another. A f(3v points 
are wortii making, hwever. First of all, the evidence from preschool 
e'^al^oations has suggested i±at \^r/ directive approa^ies favor tlie 
achievement of the educati.onally ciasadvantaged:'^'" Bissell (1970) shows 
tliat lev/ SES cliildren do best in the most directive programs she 
exaiiined; t±ie analyses described in this report indicate that cliildrcn 
without prior preschooling (sec^on 2) and those initially scoring lov 
on tlie PSI (section 1) achieve more in behaviorist models than in less- 
directive prograins. The freque^ncy of "conpetenoe" responses is, I 

\ 

tiiink, one 'more aspect of "educational advantage", even though- this 
v£iriable is i-iot higlily correlated with SES, initial IQ, prior 
preschooling, or age. In section VTI , Part I, it is suggested that 
d^ildren making n^y coiTpetence responses mi-^t have an advantage in 
less directive models because saying "I don't know" is a response 
likely to elicit heir, and information fiom adults — while passivity, 
refusal, or si±)Stitution my not. It is less clear w1iy sucli cruldrai 
would be "at a disadvantage in more directive models — unless^ adults 
in beJiaviorist models respond negatively to this style. 

Taken together, tlie 1969-70 and 1970-71 analyses indicati. that 
with respect to cliildren. making many passive responses , Bank Street 
teachers may act differently than teachers in other less -directive 
models. The model interactions with; "passivity" suggest tliat in 

■'"I use this term in its broadest se^nse^ to refer to groups of diildren 
who tend to do less well in school. 



/ 
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otlier less-directive rrcdels teachers may give less instruction anel 
attention to children who respond passively to prctolenis wliich they 
cannot solve unaided."'" It iray be that the Bank Street program is 
different because of its stronger eiiphasis on socio^-emotional develop- 
ment/ If the nrxlel focused tellers' attention on goals in tliis 
area, it iray make them more aware of the needs of children wlio act 
very withdr^Ti. Alternatively, socio-emotional growth may affect tlie 
IQ test scores of these children more directly than those of less 
"passive" diilcta?-n. Other interpretations are clearly possible; it 
would take direct observation in classrooms to be sure which ei^pects 
of tJie model are'^st relevant. 

These two variables soeri to be in some ways more interesting than 
the otliers considered in ljd^ report, because they related so much 
ntjre directly to 'the child's actual behavior in a cognitive situation. 

We still do not kxxM v^y a child behaves in particular ways during tiio 

« 

IQ test. Nonetheless, the data suggest that model guidelines infliiejx:6 
tlie way teachers respond to these different response styles. It seems 
likely (though as yet unproven) , that i-f ou^^^dex of resporise style 
were more sensitive we could see more substantial model effects. 
Perhaps we would then be able to jijdge more precisely which aspects of 
particular mjj^els are mos^- salient in* favoring the gains of one or 
another type of c±iild. 

^ — ^ — ■ 

■4here is evidence that in at leaat one "open" preschool, teachers initlati 
more contacts with children who frequently seek then\ out. ^^jo MDnacjh.iu 
(1971) for documentation of the w|iy in which patterns set by the cltild-^ 
ren in the fall are rrmntained thrpugh the spring by tlie tcat^tiers. 



PART III 
DIS^USIilON 



158. 



Discussion 

The introductr)ry pages of this report raise three questions con- 
cerning the interaction of child and nrxlel chai"acteristics . First, 
whi ah ^characteristics of childrr^n interact most .powerfully with model? 
Second, what are the patterns of interactions; are the considerations ^ 
which other researchers ha\^ used to categorize prograiiB relevant to 
the interactions we observe? And third, how iirportafit'^^^re interactions 
in explaining outcomes on oogvitive tests?! Section Vl/l of Part I 
presents tentative' ansv.'ers to these questions in the light of the 
1969-70 Planned Variation data. Many of these predictions 'are r 
sup^rted by thie 1970-71 anaiyses; some require further qualification.* 

Gener£il Predictions and Findings 

ft 

1. Predictable, significant interactions of model with ethnicity 
and SES will not be found. 

> This prediction is supportjed ,by analysis of the second year's data. 

In the 1970-71 PV data, in!"^actions of model with ethnic^l^ are signi-^ 

ficant for the^PSI. iiwever, these interactions are rib^ in 'tJie direction 

predicted o^ the basis of the 1969-70 PV data, Fbr the coT±)ined SES 

measure-H^^ch weights equally family size, mother *s educational level, 

and family incoma — interactions with model are trivial for both tJie PSI 

\ ... 
and' the Stanford-Binet. ^Interactions of model with indi victual SES 

'oonponents are in some c\ses significant, but they do not follav a 

-consistent pattern. 
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2. For most model's the effect of sex on test soore will be small. 
For' one or t^/o models, hcwever/ the effect will be predictable 
and significant. 

Although sex differenpes on the -Stan ford-Bine t are in the direc- 
tions predicted, th^y do not reach, statistical significanoe. For 
cliildren witiiout 'prior preschooling sex effects do appear to be small. 
There is, hcwever, sohb indication that for children past the .first 
year of -preschool , sex my affect achievement more strongly: tlie 
PSI data shw second year boys in more-directive models scouring sub- ' 
stan ^al^ luc^er than boys in less-directive models; diffcrenotjs 
bcbveen the achievement of girls in more- and less-directive models 
are negligible. 

3. An interpretable interaction of ^ge with model is unlikely. 
The 1970-71 data — particularly the' IQ data — tends to sipport this 

predit:tj.on . Hcv;ever, there are 'some indications that on this round of 
data the two behaviorist models, Bushell'and Engelirann-Becker, fall 
togetlier ift favoring the PSI adiievement of younger children (this 
is not true in the 1969-^70 analysis) . In the less-directive models ^ / 
age appears to have inconsistent effects on test scores. 



^ 



4. Interactions of model with initial achievement , prior pre- 
schooling , cind the two i^psponse style variables / passivr^ " 
and " conpet^ce " may follow logical and predicJi^Dle patterns, 



erJc 



is prediction is supported, in a limited sense, by the 1970-71 
PV data. On the Stanford-Binet , interactions of the t^o respond d 
style variables' with model and model-group are as hypothesized. 
Interactions on the PSI' are nqt significant. 
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Interactions of model and irbdel-group with prior preschooling 
also follow similar patterns across the two years of PV data: on both 
tests children with prior preschooling appear to gain somewhat more 
in the less-directive models, while first-year children do best iiHnore 
directive programs. 

. Interactions of initial achievement with model-groip follow; 
predicted patterns to some extent. However, tii^ s'^tement recpires 

' considera)Dle qualification: the initial IQ variable, used in tx)th 
1969-70 and 1970-71 analyses, looks quite different on the t^p sets of 
data. But v^en initial achievement is measured by the PSI pre-scoro , 
on the 1970-71 analysis, interactions — a^ least for the PSI — are as 
predicted; « Children of^low initial soore*do better in mDre-directive 
models than in less-directive ones^ v^ile for high-scoring children 

' the opposite ^s true. However, because of the different patterns 
found for the two indeperdent variables initial IQ and PSI pre-soore, 
v;e must be very cautious in assigning iiiportance to those results, 

V 

5. The "directiyeness" continuum may apply to interactions of 
' initial ^ ability , prior preschooling and " oonpetenoc " with 
iltxiel; if an 'Exception is made for 3ank Street, this dimen- 
sion may apply to interactions with " passivity " , 

The 1970-71 PV analysis tends to si^^port this- prediction. As 

indicated above, the interaction of PSI pre-soore with model-groi?:^ is 

significant (p < .001) , and the pr^cted direction, for PSI 

groi?)ed-mDdel regressions. Interactions of prior preschooling aiS^ 

"competence" with ikxiel-groip follow predicted patterns and reach 

acceptable levels of statistical significance, (p < .005) on IQ 

analyses although 7\pt on the PSI. Interactions of "passivity" witli 
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iTodel are as predicted on th^e IQ. Neverttieless , confimation of 
predicted patterns is not as strong as it might be because in general 
.the inberactioQs reach significance on only oiie of the t>/o tests. 

6, The dimension of directiveness does not apply to. interactions 
of nnodel with sex. Interactions obser^;ed on the IQ measure 
nay relate to quTte another aspect of the learning ^environment 
the degree to \>tiich adiil.ts use concrete objects in their- 
teaching . 

The 1970-71 data do not suggest striking oonfirmation of this 
prediction . Although sex effects within models are in the predicted 
di^^tion for the Stanford-Dinet , they do not even approach statisti- 
cal significance. Furthermore, there is scxve indication that the 
dimension of directiveness may. apply to interactions of model cu\6 sex 
in the PSI. The PSI grouped-rtr)del regressions show a sifcstaniial 
and signi-ficant seco: id-order interaction of sex, ncfdel-qroup , ^and 
prior preschool experience. According to this analysis the oontribu^ 
tions of sex and model-group to achievement are essentially additive 
for ■ first-year ^childxei:: girls do a little better than boys; more- 
directiv ^ models seem to boost axjres a bit more than less-directiv::^ 
qnes. For children with pric^r preschooling, hcwever, t±ie^^tuation 
seems to be quite different. Althou^ girls score abouv_ the sarre 
regardless of whicih type of program they are assigned to, boys do - 
substantially (nearly three-quarters of a standaurd dr^viation on tiie 
PSI post-test) better in the;more-directive models. 



7 . None of the eight PV models will prod^ne optimum gains for 
all types of children across both cognitive measures • 
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This hi^tiiesis is supported by the 1970-71 data. Although the 
main effect of the Weikart inodel^on .the Stanford-Binet is so strong 
as to dvarf interaction effects, this is not true for the PSI (see 
Sirdtli, 73, for a detailed analysis of nrdel effects on Uie PV ^ 
cognitive battery) . In terms of the IQ test, then, a"^ 1 types o£- ^ 
children irnke largest/ gains^ in the Weikart model. Hcwever on the 
PSI the situation is/ different:, for this test interaction effects 
tend to be cis large as model effects, so that the model vs^ich 
produces op\±iTTum gains for one type of child is not the one which 
works best for another. - " • 

SuniTiaiy and Conclusions ■ . 

These general hypothese3 provide a good starting point for a 

> 

discussion of broad questions about the relative significance of 
different -child variables , ' the usefulness of conventional ^nt)del 
groupings in predicting interactions, and the overall inportanoe of 
interactions in explaining oognitive outcomes. 

The first question raised in the introduction concerns the rela- 
tive inportanoe of interactions of model with different varicibles or 
types of variables. As I noi^d^jji the discussion which concltdes 
Part I, tliis is not always easy to evalixate, since the size and signi- 
f icance of an interaction uoes rot necessarily tell us ho^^ important 
it is. Itius, ethnicity-by-nodel interactions are significant, or 
nearly so, for all analyses. But because tl~ie direction of the observed 
effects is consistent neithor across years nor ac.i."oss tests this / 
interaction does not help us to predict wliich ^children will benefit 
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most froin particular models. In orc3er to decide which variables are 
most important, it is necessary to consider the size and significance 
of effects, the degree to which tliey are oonsistent across two years 
of data, and the interpretability of the pattern observed . Using 
these criteria, the l3vo response style variables, "ccnpetence" and 
"passi'^/ity" seen ^to be among the most important. Although inter- 
actions of these two variables with model and. model group are insig- 
nificant on 1970-71 PSI analyses, the interactions are significant 
and in the predicted directions for the IQ analyses. On this measure, 
the pattern of observed effects is tlie same for both years of data, 
and make^ sense in the light of what we know about preschool curricula 

To a more limited extent, we can say the same thing about prior 
preschool experience. Altiiough not all the predicted interactions 
r^di statistical significance, the *pattjem of effects is^ery similar 
across the two^years of ^ta: children with prior preschooling gain 
inos': in* less-directive models, Miile fir^t year children do best ir 
mo re -directive progranis. . . , ', ' 

For three *other'diild characteristics, initial achiev^nxant , sck, 
and age, the 1970-71 analysis indicates, the existence of interpretable 
interactions of some magnitude. Hcwefver, since these interactions are 
unreplicated, I' cannot speak about them with equal confidence.^ 

Interactions of initial achievement, sex, and age with model 
appear to affect children's perfomiance on the PSI post- test but rat 
on the Stanford-Binet. The 1970-71 data sioggest that behaviorist 
models favor the PSI achie\7ejqent of young children, those initially 
scoring lew in the test, and ofSboys with prior presdnool e^q^erience. 
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Within-TTodel differenc€is are smaller and somewhat less oonsistent for 
less -directive models. The analyses relating to age and PSI pre- 
score lead this writer to infer that behaviorist approaches are 
especially efficient in facilitating the learning of children who 
ha^^e not yet reached a certain basal level of achievement; they 
suggest that other, more open-ended approaches may work better for 
children who because of age, prior preschooling, or nat:xfal precocity/ 
start the year somewhat better prepared. 

Tliese results parallel those reported by Bissell (70) , in her 
analysis of the contribution of SE3 to final test score in different 
types of preschool programs, and to Bar-Yam's surrmary of ATT studi(\s. 
Bissell 's analysis shews that althou^ children of higher SES outscoru 
lew SES children in less -s tinctured or directive preschools, this is 
less 'often true .in more-directive programs like Bereiter-Engelmann. 
Similarly, Bar-Yam reports tliat in a nunber of studies .of older 
children's l€iarning, students of lew ability appear to gain more in 
"direc&ive" programs tJ-ian in "permissive" ones; for high-ability 
ehildrnrl Uxe choice of curriculum appears to influence performanoe 
less. As noted earlier, tliese studies differ from Planned Variations 
in a nunber of ways. Nonetheless, thie similarity of E±ie patterns is 
sugaestive. • . 

Interactions of nDdel cind model-group with two i-ejiaininy variables, 
SES an.d ethnicity, appear to 'be of a good deal less interest'. Althou(^' 
interactJ.ons of model with ethnicity are sigi^icant in bom i969-70 
and 19'0-71 analyses, the patterns are inconsistent, even oontradictori^ 
across tiie two tests and the two^ years of data. Interactions of SES 
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aiid ncdel are not significant in either yeai^ ' analyses when SES is 
defined by a conbined measure.. 

/ The PV^ data indicate that the finding of Bissell and others that 
' iTTDre-directive models favor -the achievOTent of lev; SES children may 
not. hold when the models are iinplenBnted in the conte^ of Head Start. 
Interactions" of irodel-grDip .(EngeMarin -Becker and Bushell vs, EDC,. 
Bank S^J?eet, and Far VJest) and SES conponents do not eveii approacti 
significance either on IQ or PSI analyses. Furthermore, the main 
' effect of model-group is insignificant (and favorable to less^-directive 
models) on IQ aneilyses, and rather fragile on PSI analyses. (Although 
th^j effect favoring mo .re-di recti ve models is significant on s^me 
.nalyses, it is insignificant ^on others^; the magnitude of the effect 
depends on the choice of otJier independei^ variables) . Knwing that 
the whole PV san^^le is of low SES' (coT|parj^ to national normsi wo had 

expected to f\n<3 s'^oi^ effects favoring more-directj ve rc^dels on 

. ■ ' 1 
both cognitive measures^ but this is not the case, 

« There are, I think; tWts general points we can nake about the 

relative importance of the child variables coniiidered in this r^pc .t. 

First of all^ the variables vAiose interaction with model foll^ the 

most consistent pattern^ acro^rs the twc^S^^^ars data are those whiclf 

relate mDSt directly to the child's behavior cund experience as a 

learner: the respcxise style variables, and prior preschool experience. 

Second, none of the variables which interact interestingly with model 

the NYU booklet 4a, which t^ts kncwledge of le-^ers^ ard nuriDers, 
the more-directive models do show stronger gains, Tiiis is nob surpris-. 
ing, as the other irodels do rot place major alphas is* on this type-of 
i^nY^" learning, (See Smith, 73,) \ 
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or model-groijp describe irfoatablu^ characteristics of children*- All of ^• 
them describe the child 'at a particular point in liis, educational I 
experience. Age, PSI achievem^t, prior presGJ-iooling, and response 
style: all these things change fqpia-year to year. Sex by iti^elf 
sha/7S no consistent interactions with model-groijp; only when.it is 
considered in corbination with prior preschooling is the ,"i|nteraction 
strong. Tlie iirpact oJ^^rti,c\iLar models on little boys may depend on ^ 
whether or not they haVe been in" school before. IQ., \>^idi ch^inges ' 
less 'o^^er the years than achievejrient level , interacts far less fx::^ver~ " 
fully with model and model-group. 

Ihis second finding — that tiie diaracteristics which' interact most " 
strongly with program type are those which are not iimutable — is 

strikingly consistent with results reported in Stodolsky*s obsen/a- 

'■'1 ■ ^ ' ' , ■ 

tional study of children's choice-making behayior in several preschools^ 
(72) . Stodolsky presents correlations of ten cbservational* variables 

with age, mental age"'" (as measured by the Stanford-Binet) , and IQ; she 

• * '/I 

also reports effects of sex and SES on, frequency of the observed 
behaviors. Correlations of obsers^^ation variables with age and mental 
age are strong; sex effects on observed behaviors are at a minimum, 
but differer.oe3 are significant for two of the ten variables-; effects 
of initial IQ or SES on the ten observation variables are all insigni- 
ficant. Ml Stodolsky 's observational variables " relate to'childiV;in's 
^beha-v-ior in preschool settings wKere they musfdecide for themselves 

. 6— T — 

•'■Mental age (NPV) as measured by the Stanford-Bir^t correlates .75 witli 
PSI pre-score in the PV sanple^(fall 1970; see ^I he Quality of'tfie Head 
Star t Data ; 1973) . The correlation of IQ with PST scdre is Lcwci* 
(.54) because the IQ, unlike MA or PSI score, is standardized fon aye. 



to spend time; differences on such measures ipiaht well relate to 
diixdren's achieveinent in less -directive models. 

To me, tliese resuJ.ts mean one tiling: tlie stjratxjgy v.liiah v;orks 
best for a child today is ix)t necessarily tlie one.wliich will be 
optimuni next month or next year. This is nothing nw: plenty of 
good teachers use this knc^v^ledgc every day in their classroom, 
ailcwiiTg first-graders more freedan, for example, as their reading 
skills inprove and they are more able to work independently. Nonetiie- 
less, the point needs enfhasizing: all of the P\/ analyses descriix^I 
here lend weight to the ic*ea that we can ircrease presclioolers ' 
acliievenient by adapting curriculum in particular ways for particular 
childrtm. None of the data support the notion that the choice of 
curriculum for a particular child or groLp of children sht)uJ.d .^xj finaJ.. 
Those characteristics of children which do not change — ethnicity^ 
SES and seix — are precisely ti\e ones which do not shcv/ consistent or 
i.nterpre table interactions with model. 

The seaoi")d question vv^iich this investigation has sought to ansv;er 
ooncems the usefulness of various model groupings in predicting and 
interpret-ing interactions. In the disc^ission v^ich followed Part I, 
I answered this question tentatively, saying that the 1969-70 data 
suggests that the d-'mension cf "direct! veness" applies to interactions 
of irrdel with ini^j.al IQ, prior preschooling, and the two response] 
style variables, but not to interactions of model with sex, ethnicity 
and age. The 1569-70 analyses raised tne poss.lbili-^^ that interactions 
of sex and model might relate to another diinension: the degree to 
which concrete objects are used for teadiing and learning. 

ERLC 
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The 19 70-71 analysis suoTOrts the idea that rhe d]jn£:jnsion of 
ciLroctivaioss applic^s tc^ interactioas of initia] ability, prior ore- 
sdicx^liii'j and res[X>nse styl^' \^ri catties v;itl) nodel. But tl\is sc\::ond 
year's data sugge^sts that the dimension rruy also relate, in liinitjed 
ways, to interactions of age and sex with' rrcdelr These interactiorj.^ 
are obseiA^ed only on PS I analyses, and not on tlie^y-. Sex effects 
on Ui^. IQ give very limited support to the tlieory tliat an enphasis 
on learning througli concrete objects will favor the IQ gairis of boys 
nxjre th;in tl^ose of girls. F jv.'ever, the deserved effects an- rx3t 
signjificant . i 

'file dimension of cIl recti \^eness thus looks rore irTpc_^rtant to 
interactions djser\^ed'in the 1970-71 analyses than to th6se found m ' 
1969-70. But wiiile saying this I want^ to eirphasize again tliat in 
tliese analyses, the n-ain effect of "di recti veness" is small. Althougii 
chi-dren in directive models score a little bit higher on the PSI 
tliey do slightly (insignificantly) less well on the Stanfort3-Einet . 

TJiese observed differences beta^een the two teste axe consistent 
witli early resulte reported by Robert Soar in his analysis of process 
and outcome in selected Follow-Through models (71) . In tlie first two 

i 

9 

years' data. Soar found 

a 'tendency for abstract measures of pupil grcvrth to relate 
positi^-ely bo classroom behavior dimensions that reflect 
pupil - freedom and self-direction, whereas siirpler, more 
conG:^te nfeasures of pupil grcwth tend ipt to relate, or 
e'\;eji in some cases to relate negatively . In contrast, but 
relatively consistently, the siirpler measures of pupil 
giitvTtii tend to be related tc classroom behayior dimensions 
representing more structure and more control on the teaclier's 
pa'.*t. 
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•'I'aosc relaLioiis do not: hold m So<"ir\s analysis of later lolla-/- [lirouf;;! 

data (Soar, 1972) . Nonetlielass the early patterns are of inten:^st 

■ --"auso tivjy par .al lei tiiose rerorted for the 1970-71 PV analyse:^: 0:1 

the 1^1, a test hoa\^ily loaded v%atli informational itc^is, d^ildax^n m 

f 

..ore-directi^^'e nxxlels score a little hidier tlian tl^iose in tlie less- ' 

\. 

dircctiw cjro'jp. On the Stanford-Binet , by contrast, the very nrdest 
f.md i:isigni f icaJit) dilferences betvoen model-groups fa\or the le^^^s- 
di recti \'V ''irxlels. 

I'l-ic* ti^ird question we have asked about interactions child 
dvai"acteristics aand iiodel concerns tlu^ir overall- iir^ortance. (Jan wt- 
^;ay tii.it, one nrxiel or t\^y2 of iTodcJ is "best" — in tJie lirutc^. 1 s^MiS^: :A 
rvxxipiizjnq coqriitive c/ciins — for all diildren? Or aru intfjraction 
effects m f^ctjTDje substantial than model effects? Thie 1969-70 ^''^ 
a:\alyses indicated that the answers to these questions were^ dif fefent 
for different tests; althoughi on tl:ie Stanford-Binet interaction effects 
v/ere more substantial tli^i model effects, this was less often t iX' 
for the PSl. For all models except Weikart, a similar pattern is 
c±)served in tlie 19 70-71 analysis. The effect of t>f^Weikart nodel^ on 



/ 



^ to c 



10 tX3St-test soores is, however, so substantial ± to dwarf tlie i:np.)r(.- 
ance of interactions. (For more on :his , see Sndd), 1073) . 

On thcjise^of the 1970-71 ' analyses in which five models are grouped 
as more- or less -directive , thfe interaction of ntxlel-group witli child 
characteristic^ explains subs'tantially more of the variance in post-test 

''"Had the Fort Walton Beach Weikari- site not been ej^cluded in 1969-70 ainalyses 
the pattern across the two years would have been rvKjre sLmilar. 
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shores — Ix^th PSI and IQ — than does the main Gftxx:t o: nrxiel-yn^^ij"). 



rrain effect of model-group explains 1/3^, of the unufoo vai-iance 




in PSI test scores"'" and .5?, of the variance in IQ S'Cores . ^ 'lntez~- 



actioris of background variables witli model-group explain more tlian 
121 of unique variance in both rreasures. Tai:)les in Part II which refer 
to grouped-in^del cmal^^e^ (lb, IHd, IIHo, and vllb) indicate tliat 
neitlier approach jfnorc direct.ive vs. less-diroctive) is optirTiim foi 
all children. 

i Tliis is lessN:learly trtie on the v^edyses where effects of clie 
eigiit models are coi^idered separately. Effects of nodels cxplai:; 
soxDohat more variance, and interactions of irodel with child variables 
o:j^lain less. 5Jonetheless , for the PSI w^e can scill'say that no one 
model produces optiimim results for all children (see for 6:<ar[\Ac, 
■l\it:>le Ila, wliich indicates ^at Tucson maximizes PSI gaiivi 'Tc^r diild- 
n^n witl;i prior pros choo ling,- while VVL.ikart favors those witliout 
presahool e;q)erience) . ' ^ , 

Ihe model analyses of IQ post- tes T scores reveal quite a differ- 
eiit s'tuatdon. Althou^ interactions of model with se^^yeral Hiild 
vari: les are significant, the maia effect, of the Vfei,kart model on ■ 
IQ post-test scores is so sibstantial. as to raduoe-the irrport£Jice of 
interactions. For 1970-71, we could say that, in temis of. IQ, all 
ti^s of children gam more in the WeiJcart model. 

■'"F^m PSI regression 3-*g3:xiuped models. 
^From IQ regression 2a-grouped models. 

-^Between-model differences are small for the other seven models , so 
that if WeiJcart were excluded, jno one of the reiraining ^[od^ls would 
ptxjduce optmim IQ gains for all types of^x^ldren* 
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These fiixlir.cjs *>iavo, I tliink m certain implications for educational 
Tx;lier;/ and reseat'ch. First, and nost .iinportant, thc^ supix^rt tl^.o idea 
tJnat ^xJucational diversit]^^ can benefit childjnen. AJ.tr loucjl-i tlie P\' ^Lita 
indicate uiat one model, Weikaurt, ii^y be astonishingly successful in 
proTOting IQ gains with all kinds of children, they do not sugopst 
that one type of nxxlel (more-directive 'v^ . less-<iirect.i :) maximizes 
cc>g-nitive gairu: for^all kinds of childn^n. The inconsistent patterns 
fpujid in 1970--71 analytics ^on the PSl and IQ post-tests suggest tliat 
file ahoice of educationkl^rograrp. slio'uld depend on tlie outoome sought 
as well as on 'the children^ since niain effects as well ^ interaction? 
^ire soiTt3%^at diff^5:i^t on the twp tests. 'Tie Weikart model, for exarrple, 
althougii outstanding in its effect on IQ post-test scores, is scx^cwi-^.^Tt 
less effec:tive th-rin Engelmann-Becker in raising PSI scores. - - % 

If the FV aiialyses indicate that a choice of curriculum vv^ich 

takt. . into account the differences among cbiildren may r^Lse test 

scx)res significantly they also su(jgest that diversity should be ^.^ 

created on the micro rathi^r- than ' the macro level— ^itliin sdiool*;, pre- 

school centers, or c^c^srooms, rather than iust witi'jin cities or ^ 

- A * 

scl'iool systems. say tins for two reasons* First, ail the evidence 
from the PV analyses points to the fact that global d*nographic 



variabiles like ethnicity and SES do not interact in a prbd.iGtable way { ^ 
.with model /"at least in a Head Start setting. Second, these data 
indicate that^ children's educational needs change— that v^hile one 
model ray efficiently raise the scores of four-year-olds without prior 
preschooling, another approach may beriefit these clii''dren a year 
later. If, as I have argued, the variables which mecter most are 
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tliose wfiich rclab^^to classroojn behavior and learning stifle, then the 

' V 

design of curricula should be flexible. Otherwise half the benefits 
of diversity will be lost. ^ 

Vki ha^/e, I think, always" kriown that no one educational approadi 
uorks well for all teachers, li we can also dannonstrate that no one 

4-. 

type of curriculum is best for all children, then perhapo refonnerr 

should stop tiying to change 'teachers' styles and instead start help- 

ing individual teaciiers to do v^at tliey see as a good job in the way 

in wh^ch they feel niost effective. Ihat. .effort, plus assignr«Tent of 

children 'v^7hich takes account of pi^il needs and teacher:."' styles, 

niight raise children's scores' as well as t^adiers' morale. 

What, if any, is^ tlie educational sifjnificance of the ef iccts 

described in these pages? <iLven v/hat ye have begun to suspect boUi 

about Sie limited inpact of school differences generally (Jencks 

et al. , 72) , and about the mortality of preschool^Q gaijis (Steams , 

71)', it seems guite possible that difference of half a standard 

deviation on the PSI or Stanford-B^net will not in fut.Jire years 

translate itself into Idgher^ earnings, greater social mobility, or 

even improved understanding of fifth grade arithmetic. Nonetheless, 

differences of this inagnitude do suggest tha: in tl^ie short-run, over 

. the course of the preschool year, children are learning saiie kinds of . 

things, considerably fastei than they were before the Head Start 
* 

experienc::e. The analyses described here suggest that for particular 

J- ^ ., 

types of children some Mutational environments facilitate tliis 
leamxng more than others. :nd v^ile these differences may make Id/ttle 
^ iirpact in the long-run of people * s - lives , they may r '^lect some / ^ 
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important differences in tlie matdi betv/een cliildren^s present needs 
aixi tiieir preschool experience, % 

Given the very real limitations of the cognitive tests used here, 
and tlie great importance of other goals of presdiooiing, botli cogni- 
tive and non-cognitive, we cannot be very sure that optiirdz^ng gaiiis 
on the PSI or tl\e IQ is of primary iirportance. But I do think it 
wortliw?iile to investigate wliy some children gain rrore than others in 
Mrticular environments, c±)servational studies which would 

illuminate this point might well shed li<^t on the first question: 
what kinds of grwtJi do these test gains reflect, and hov inportant 
are they an^^'way? 

This report demonstrates, I think, the need for further researcl-i 
on tlie interaction of child and model variables. The specific findings 
discussed in these pages are nc^^ere near clear-cUt enough to be con- 
fidently translated into classroom practice. Replication of any 
pattexrjri reported here woiiLd be interesting and important. Nevertheless, 
one point seems to stand ou^'* "ne^earch directed at the question of 
what kinds of programs will benefit particular children in particular 
ways should look at characteristics cjf childx'eJi v^ch relate as 
directly as possible to their beliatyror in oogniti^ situations. This 
is no )ne^ idea: a number of good studies have done o^actly this, often 
with interesting results (for a sumnary and review of s^yeral' sucli 
studies, see Le£;ser, 1971) . However, too little work of tliis .sort has 
been done on the preschool level: we need more sensitive indib^s of 
response style and ideas about what other variables relate to ^\ 



children's classroom needs; we also need observation ^tudies vvtiich 
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illuTiinate the reasons for observed intx-iractions. 

In designing studies wiiidi might help us undarstand v/hich child- 
ren cire Likely to irake what kinds of g£iins in particular environircnti^ , 
we should bear two points in mind, botli lessons of the Planned 
Veiriations Study. First, almost all classrooms provide a mixture of 
more end less -directive situations. V7nile this ntiy make inberi3rct-ation 
of data rrore difficult, it provides a real opportunity for those 
interested in children's learning to c^:)serve one child in a range ot 
learning situations and learn what ^'response style" means in prc\ctico. 

PerJiaps we need instruments whicli help us cfoserve the differences — 

(I 

and similarities — in ways in v^iidi children respe>nd to nore and lass 
formal situations witiiin the seimc classroom c'lnd ways childreii 
affect learning environinents . 

The second lesson whxL.1 e^nerges from.tlie analysic of Planned ^ 
Variation data which is described here is that in order to learn 
about interacti.ons we need sjmll experiirental studies designed io test 
specific hypotheses, ^in data dredging operations of^^^e sort descrLjed 
in this^-^P^rt one ton often lacks, in the end, the very information 
one needs i^i^n^r to understand the irost provocative findings. 
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APPE2^DIX 3 

Pr^;i^V-I EFT-IXTS ON HERTZ IG-BIRG-I RESIXDNSES AT TIME PRL'TEST 

Because the St^lnford-Binet protest is given appro:<imately three 
weeks after the opening of scliool, it is quite possible that differ- 
enc model enphases might affect cl^aldren's style of response even on ' 
the iniLial test. It is interest to k:x)W whether this is so— 
to knou^, in the temis of this thesis, v^ether, for exanple, a high 
proportion of childr'en in one model ;soore "high" (above the median) 
in pr^\jsLve responses, vvhile m^st of n n.se in another model score low. 
Aiid if tetween-m^del dif fer'ejices of this sort exist, we must ask hgw 
'tiiey relate to the interactions re[x:>rted tiiese [^ages. 

Table A-1 shovs tlie nunber of children in each mo<iel who score 
high and lev; in passive and conpetence responses j>r 196*^-70 arid for 
1970-71. AyC test has been i3sed to evaluate tho significance of . 
between-iftxlel differences' for each variable and each year. Differences 
are significant (p < ,01) both years for incidence of passi\'e responses 
and, in 1970-71, for incidence of coni>etence responses. Differences 
are not significant above the .05 level for incidence of conpetence . 
res{X)nses for 1969-70. 

\#iat causes the observed differences and hdw do they relate to 
i.nteractions reported in the test? If the differences dern^e from 
moded effects on response style. we would expect to find oonsistency . 
from year to year. The patterns for the two years of data are not, 
in fact, strikingly consistent. This is especially true for "oonpe- 
tfince^ responses: in 1969-70, 67% of the children in Bank Street 
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classroorrB are classified as lo; in passive responses. In other 
models feMer than 60% of the children ar^ -^cored low. In*^ 1970-71-, 
by contrast, ^oms^at fewer children in Bank Street are classed as 
lav in oorrpetence responses than in the sairple as a whole. The 
'X? ^value' is a1:tributable instead to the large nurrber of Engelironn- 
Becker d-jildien sod ring low on^tliis variable, and the large nurrber of 
EDC children scoring high. 

The distribu-^ •''on pattern fbi^ passive leesponses is only sliglitly 
.' more consistent across the two s§ts of data. In 1969r-70 the signi- , 
ficance of beb/een-ntxiei diffea:^ces: is^ mainly attributable to the ■ 

. ^ large nunber t)f Gordbn childy^ iraking no passive responses/ whfle Ih 

' - , ' . ^ ' . " ■ ^ " • O 

1970-71 sizeable deviations from th^. generaj g)attem are evident for ' - 

■ ' • . ' ■ \^ 

Engelimnn-Becker// Tucson, Bushell, and Weikart, The single oonsis-; 

^ ■ tency we observe is the laige hutrber of Engelmann-Becker children 

makijig passive responses both years, v p 

o Given the lack of oomis tency between 1969-70 and 1970-71, I * 

would attribute nost between-inodel differences' to tester effects, I . . 

TOuJ.d niake a t^tative exception for Engelrnann-Becker , saying that.. * , . ^ 

the data does Suggest that pven^ after a few weeks in thc»t model, ■ 

children may make more passive responses td IQ test items than we ; 

would otiiefwise expect. In viev of the mcdfel ern^asis on correct 

answers, this does not seem surprising, ^ . ^ ° . 

How do -the between^iodel differences reported' ^ere affect fehe 

interpretation of intel*actions between response s^yle variables and 

FV models? First, the significance of between-mbdel differences 

suggests that the" Heirtzig-Bir^ variables iTiay°not be as reliable as 
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we TOul<3 hope — that they are prd:>ably affected to some degree by 
differences between testers. This is not surprising, but it i§ 
unfortunate. "Second^ the general abs^ce of oonsistent iriodel effects 
on potest data suggest that children's initial response style is 
.in ][TDSt\ cases independent of ifnDdel. A possible exception, Engel-"^' 
ittinn-Becker, may increase children's tendency to respond passively 

0 

even at- the tijne of pretest. Given the fact that this model may » > 
enooux'age thj.s type of behavior it is somewhat surprising that the 
mgdel does not shcw^tronger effects' favoring diij(ctoen hic^ in 
p&sive responses. ' q ^ o ^ 
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■ APPIMDIX C ■ ■ 
ADDITIONAL NOTES ON SA^^PIiE AND METHODS 



1969-70 Analysis .■ 

Analyses c3one on the 1969-70 PV da-'^a do not. include ^1 children 
aijd all sites. Individual, children are excluded v*ien the data 
recorded for tham appears to^be" inccoplete .o^^invalid. In order to 
be included in the ^analyses , a child^has to meet^all of the following 
criteria: . * 

■a 

• . * - 

1. The ages given for his pre-- and post-test are carparable/ 
This means o that the chronological age listed for the spring 

■ •"test exceeds that given for the fall test by eight to ten 
iTonths. Valid ages are crucial for the Binet-, siijc^ the 
chronological age is used in oonputing IQ. 

2. ^ English is his fi^st language. 

3. His a^^e at pre-test is 47 nonths or more. 

4. His test scores are judged valid by the presiding tester. 

5. Infornation on his age, sex, and ethnicity are .ooirplete. 

6. His ethnicitr/ is given as^ Black or \^*ute. 
Three sites — Port Walton Beadi, Tuskegee, and Oiraibi — are 

excluded from all 1969-70 IQ analyses. Port Walton Beach and Tuskegee 
are eliminated because the- Planned Variations study suspects ^^j^ 
validity of 1969-70 IQ data from these sites. Oraibi is excluded* 
^frbm 1969-70 and 1970-71 analyses 'because ^1 children in the site' 
are American Indian;' since no otiier site includes Indian children 
O the sanple can not be considered oonparable. 
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1970-71 Analysis * ' 

Criteria for including individual children in the 1970-71 analysis 

are sdmilar to tliose used fOf the 1969-70 data, with thip^se additions: 

h. Children are excluded if their age at pretest is less than 
46 months . 

b. Children are excluded if inforimtion on their 'prioif preschool 
experience is- missing. 

c. Children are excluied fron the snaller Stanford-Binet sanple 
if either their PSI scores or their Stanford-Binet scores 
are missing or invalid. • * • 

* ■ ■ ■ 

The only site excluded from ti\e 1970-71 analysis is Oraibi., 
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APPENDIX D ■ . . 
NOTES W THE ANALYSIS vOF THE .1970-71 "PV EATA 

■ This^ appendix describes the an^yses of covariance and regression 
■ analyses perfonred on the 1970-71 sairple, ' 

J ^alyses of. Covarianc^ ■ , 

I #■ • ■ 

!• Interaction^' relating to model ' • , 

A, PSI/sajTpl e - ANCDVA 

D^)endent variable : PSI post-test 

. Sanple : all children in the eight nodels with valid scores 

Von PSI prfe- and'f^st-test. N = 883, 
Design; The preliminary analysis ■of PSI took in i^nt^ractions 
of all, categorical variables included in the 1969-70 analysis- 
of post-tes't scores. The design was prior presdiopling by 
sex by SES category by ethnicity by model, with covariateis 
' ' for age and pretest score. Because this analysis showed all 
interactions involving sex and SES category^ to . be insignifi- 
cant, the final model was prior preschooling^ by Ethnicity by 
model, with oovariates for SES, sex, age and pre-soore. 

B. IQ sample - MCOVA 

Dependent variables : - PSI post-test, IQ post- test 

4 

- Sairple : all children ill the ^ght ittDdels with valid score? 
on PSI ^and IQ pre- and post-tests* 1:3 = 305. 
Design : ^ The design of the analyses' done on the Stanford-Binet 
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1 

sarple was model by "conpetence" by "passivj.Ly" by sex* by 

„ ■ . - ■ . 
SES' category by etl-Lnicity;'^ covariates were age, IQ pre- 

soore, cind PSI pre^score. > . 

■II. fi^msral IntAaction Stiy^ \ 

\ 

; 'N • Dependent variables: PSI and IQ post- tests; PSI and IQ^ gains 
Sanple : all children With valid scores on IQ and PSI pre- 
and post- test in Planned Variation -or oonparison classrooms • 
N = 607- 

Design: etlinicity by pijeschoal experience by S^S category by 
r-r - , 

"passivity" by "oonpetence"; covariates included eqer age as 
a dumniy variable ("old" and "young" divided at the median » age) , 
-PSI pre-score, IQ 'pre-score, and two-^ay interactions of these 
variables. Separate regression lines were allowed for where 
it was"' deeried necessary. The dependent vaidables were IQ and 
PSI post- test, and IQ and PSI gains (covariates on gaans 
analyses were age and age as a durmy vari able) , 

Regression Analyses 

Unless otherwise noted, all regressions have been done stepwise 
with main effects forced in and interactions allowed -to enter one by 
one to explain the maximum additional variance. Results given in the 

''"For explanation of these two Hertzig-Birch categories , see Part I., 
Section VII. * ' 

"^Because only three of the ei^t models had nore than eight children 
with' pribr preschool^^ e:^rien'C3e and valid pre-- and post- test scores on 
both the PSI and the Stariford-Binet, interactions of preschooling 
mth model qould not be included in IQ analj^ses.* Prior preschboling 
was eliminated as. a covariate because for this sanpl^ it proved 
insignificant. ' ' ' ^ ' ' 
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text;, are for the step on which the standard deviation of tJie residuals 
is minimum. " 

I. PSI regression 1 '*' ^ 

Sanple: all children with valid pre- ar)d post-^PSI scores in 
tlie ei<^t models examined. N = 883. 

a. Purpose: preliminary investigation of interactions of SES 
ooiiponents with other variables. 

Independent variables :^ models, faroily size, nother's educa- 
tion/ income, sex, ethnicity, preschooling, age, PSI pre- 
soore, jTTodel by family size, model by mother's education, model 

by sex, ^ model by race, model by preschooling. 

■ ■ • ' 

b. Purpose : preliminary investigation of interactions of age 
and PSI pre-'score wi.th other variables. 

In dependent variables : models, family size, mother's educa- 
tion, income, 3ex, race, preschool experience, age', 
PSI pre-soore; age by model, PSI pre-soore I:/ model, age by 



In regression analysis of this sort it is- only possible to ^ter 
rrain effects for seven of the eic^t motieis. Unde^" the assun^;cion 
that nodel by variable interactions for the omitted model wouM 1x2 
difficult to interpret, these interactions were also omitted, rhus, 
in order to find the equation which best described observed inter- 
actions, PSI model regression were run twice, omitting tlie Goi^don 
model on one run. And the EDG model on another. The results were 
naturally very, similar, except .v4iere an interaction with one of -these 
two models «was significant. Results are giveii' for the run viiich 
include all significant interactions, but when the. result for a 
model which is included* on both runs is significant on one run and 
not on the otheir, this 'fact is noted in the text. 

^Dunrny variables used for models, sex, ethnicity, and prior preschooling. 
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presc±iool by model; all first-order interactions involving 
age and race. 

c. ' Purpose : final equation describing interactions with inDdel 

of significant SES variables, age and PSI pre-score. ' 

Independent variables : models^ motlier^s education, inoone 

sex, ethniciti^, preschooling, age, PSI pre-scpre; model by 

moUi.er's education, model by incoire,. model by sex, model by 

' . • race, model by preschooling, model by age,- model by PSI 

pre-score; model by age by preschooli/hg; all first-order 

•interact:ions involving race, preschooling/ or age. 

- ? - . " , . ^ 

II. PSr- regress ion 2 

Sanple : all children in the eight models yiitti valic^ pre- and 

post-IQ anci PSI soDres. N =''305 • ' 

- a, ^ Purpose : to investigate model interactions with -.initial IQ 

■\ .and "opnpet^ice" . ' - . >, 

• . Independent variables : inodel, mother's education, lincone, 

"^tHTpetenoe" , ethnicity; age, PSI pre-score, IQ pre-score, 
^ - • '■ • . ^ - ' . 

/ model by mother's education, mod.el by inocxne,' model by conpe- 

tenoe, model by etlinicity*, nodel by age, 'model by initial IQ; 

ethnici^ by mother- s education, inpoama', "oonpetencc" , age, 

and initial IQ; age by mother's education, -inoone, conixstenoe 

>and initial IQ. ^ ; ■ ' ■ / . ' ^ ' 

III. PSI regression 3--groi:ped models * • 
•Sanple: all children with / Valid pre- and post-P^I soores^^in 
Bushell, Engelirann^Becker/ EEC, B'ank- Streetv ' and Far Vfest 
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programs. N = 422. 

Purpose ; investigation of interaction of all c±iild variables 
with models groi;¥)ed according , to dixectiveness . ' 
Independent variables ; group (Engelirann-Becker and Bushell 
. ^- ^ coded "more directive'*; EEC, BariK Stree't, and Far* West coded. * 
"less directive") , family size, mother's education, income, 
sex, ethnicity, age, prescliooling, PSI pre-score; all first- * 
order interactions involvihg group, ejhnicity, preschooling, 

or age; all second-order in;teractions involving group and 

h ■ 

\ 

ethnicity, preschooling or 'age. j 

PSI regression 4 — groiiped models ' ' 

Sanple : all children with valid pre- and post-PSI and IQ' 

scores in Bushell, Engelmann-Becker, EDC, Bank. Street, and 

Far West .programs . N = 183. 

a. Purpose : investigation of interaction of initial IQ, compe-; 
' ' ' ' ' f 

tenoe arid prior preschooling with models groiiped apoording to 

i . 

directiveness . N = 183. ; , I 

Independent variables : group, family size, mother'^ education, 

income, "cofpetence",* "passivity", box, ethnicity,, proschoqlincj 

age, IQ and PSI pre-scone; model group by .fandly' sJLze, mother fs 

^ i • " 

education, income,", "conpetence" , Vpassivity" , 'feex, \ fethiiicity, 

presd^ooling, age, IQ pre-soore;. age by family size,- mother '-s 

education, income, "oonpetenoe" , preschooling,' sex'; and\ PSI 

' pre-soore, etiiriicity by family size, mother's education, inotoie 

"conpetence", preschooling, sex,- PSI pre-scor'e; preschoolir^ 



by .family size, imther's education, incone, conpetence , pre- 

r 

sehcx)ling, sex, PSI pre-soDre; secx)nd-order interactions 
involving groip and ethnicity, preschiooling, or age; 
groip by sex by pre-score. - 
Purpose; investigation of interaction of PSI pre-sqore with 



groip:^. 



Indei 



!P^( 



.dent variables; as 'in PSI regression 4a, with' group 



Ipy PSI pre-score substituted for groip.by IQ pre-score 

^ < ■ 
interactions . 



V. PS I regression 5 

; Sanple : all children with valid pre- and post-PSI tests vjHo 
have no priot, preschool experience, N'= 723. 
. Pujcposje : testing hypotheses relating to ^ge by nodel* 

interaction.. , • 

. Independent variables: irtxiel, fandly size, mother's ediica- 

,. a i ' ' , 

% ■ : 

tion; «inooiTie, sex, ethnicity', age, PSl pre-3core, model by 
fandly size, rnodj^l by nother's education, irodel by incoms, 
mDdel^by sex, model by ethnicity, niDdel fc(7 age, model by PSI 
s pre-score, and a].l first-order interactions involving 
ethnidity or age. 



VI. IQ regression 1 



Sanple ; all' children in ^tlie eight models with valid pre- ' 

-V 

and poSt:-PSI arid IQ scorek. . N = 305. 



\ 



a. Purpose ; investigation of Viain effects and itodel interactions 



with SES yayi^les, age, and Ihitial IQ. 



190. 



Independent variables : model, family size, motiier's educa- 
tion, incxjme, "corpetenoe" , "passivity", ethnicity, preschool 
experience,.*, age, PSI pre-score, IQ pre-score; ntdel by family 
size, model by income, m^del by mother's education, model by 
"cbsnpetence", trodel by "passives", model by ethnicity, model 

by preschooling , model by age, model by initial IQ; ethnicity 

. .. \ . . . ^ " 

' \ ■ . 

by, family si^e, mother's education, income, "oonpetence" , 

"passives" > preschool experieLce; age by family size, mother'^ 

educatipTi, income, preschooling, and initial- IQ. ' 

. ■■ i ■ ■ - 

b. Purpose : further investigation of model interactioiis with 

initial JCQ. 

p " , ■ . . ■ 

Independent 'variables : same as above - 

•^Meti^d: main effects and interactions of model with, initial 

. IQ. forced in as far as possible • Other variables pem^Lttec? 

. o . .. ^* 

to enter stefv/ise. . 

c. Purpose ; to' test hypotheses relating to interactions of SES 

conponents with nodel , = ^ • 

- • \ - - - -\ ' . ■ ' 

Independent variables ; models, - IQ and .PSI pre-score, family 



ize, mother's i^ucation, income,, sex, etl^city, prcsdioolinch 



age, "ooiTpetenod" , "passivity", ethnicity by age, ethnicity 
by mother's education , "rucson model by "passivity"."'" 
Interaction of in^me, m^^ther's education and family size witii 
these 'models : Far\.West, Bank Street, Engelmann-Becker, 

^ . \ ^ ^ : . . . 



ese interactions are forced in because they, enter significantly 
in other IQ analyses. ' \ ^ ■ 
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Bushell and WeiJcart* 

Method ;- nain effects, first tliree interactions forced in; 
interactions with SES boirponents allowed to enter' stepwise. 



VII . JQ regression 2 — grou^^ed npdels- 

Sanple: all child^Ln with valid pre- and post- IQ and PSI 
scores in Bushedl, Engelmarm-Becker, EDC, Bank Street and 
Far West programs. N = 183 • 
^ a. Purpose : investigation of interaction of all child variables 
with models grouped according to direct! veness. 
IiKiependent variables ; rnodel--groi:p, family size, mother's 
education, incpmc, "oompetenoa", "passivity", sex, oUinicity, 
preschooling , agi^, PSI pre-score; groi?) by family size, 
mother's education^^ income, "boirpetenoe", "passivity", sex, 
ethnicity, preschoo'l^ing, age, IQ pre-soore; age by family 
size, irother's education, incoms, "cdnpetenoe", preschooling, 
sex, and PSI pre-score; ethnicity by family size, mother's 
education, income, "conpetenoe", preschooling, ^^x, PSI pre- 
. score; preschooling by fcimily size, mother's education, 
incane, "competence",' sex and P&I pre-soore; second-order 
interactions involving groip and ethnicity, preschooling, or 
^ a^e; group by sex by IQ pre-^score . 
b. Purpose ; investigation pf interactipn of PSI pre-scpre with 

*-■ 

groijps. 

9 

_ Ijviependent variables : as in IQ regression 2a, with groi^) by 
' . PSI pre--soore sxjbstituted for group by IC^ pre-soore interactions. 



VIII. regression 3 

Sanple ; all children in the eight nodels with valid pre - and 
post-IQ and PSI soores and no prior preschool ex^rience. 
■ N-= 239, . . ' - ' • . 

Purpose ; testing hypotheses relating to age by nrdel inter- 
actions/ . „ 

a. Method : main effects and first three interactions force in. 
Interactions of age with Bushell and Tucson models forced in. 
Interactions of age with otlier models allowed to enter step-' 
wise, \ , 

Independent variables : models , IQ and PSI pre-scores , 
family sj^ze, mother's education, incore, "conpetence" , ' 
"passivity"., sek, ethnicity, age, interactions of age and 
/mother's education with ethnicity, Tucson model by passivity^ 
model. by age, . ' , 

b. Method s main effects forced in; interactions permitted tc 
Bnter stepwise, ' 

, Independent variables ; model, age, etJinicity, sex of head 
, ^ of household, mother's education, income, family size, IQ 
pre~sc»re; interaction of age with, mother's educatidr^, sex 
of head of household, irioome-, family size, s^x^^..ethnicity,, 

I O T * II ^^^^ ^ 

'.and rrodel. 



•4hes9' interactions are consistency significant on IQ analyses and 
are enteral in order to iinpri^ve the model. 
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